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Preface 


This is one of five case studies commissioned by Unesco’s Regional Office 
for Education in Asia (Bangkok). The other four concerned Malaysia, the 
Philippines, the Republic of Korea and Thailand. The study of examination 
reform in India was considered to be of sufficient international interest to 
warrant inclusion in the International Bureau of Education’s series ‘Experi- 
ments and innovations in education’. 

The author, Professor H. S. Srivastava, is Head of the Examination 
Reform Unit, National Council of Educational Research and Training 
(NCERT), New Delhi. He is one of the pioneers of the examination reform 
movement in India and has been instrumental in guiding the strategies of 
the programme since 1958. Today, Professor Srivastava is an international 
authority on curricula and evaluation and, through his contribution to a 
number of international meetings, has influenced the trends of curriculum 
renewal and examination reform in a number of countries. 

Professor Srivastava expresses his gratitude to his colleagues among the 
faculty and staff of the Examination Reform Unit who have helped in the 
completion of this study. In turn, the Secretariat of the International 
Bureau of Education records its own appreciation of the author’s work. 

The author is responsible for the choice and presentation of the facts 
contained in this book and for the opinions expressed therein, which are 
not necessarily those of Unesco and do not engage the responsibility of 
the organization. 
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Introduction 


For one who has lived within the movement of examination reform in 
India since its inception, it has been a great joy to develop this monograph, 
particularly at the present time when the programme is some way past the 
trials of establishing itself as a reform of national importance. 

In the main, the study deals with external examinations at the school 
stage of education. There is particular emphasis on the secondary level, 
not only because most of the reform work to date has been done there, 
but also because the effects of these examination reforms have percolated 
downwards into primary education and have influenced the university 
level as well. The reform programme entered universities almost a decade 
after it had made an impact at secondary level. 

In writing this monograph the greatest challenge, of course, was to 
compress, within the prescribed limits, the enormous volume of pertinent 
facts and data concerning the reforms. At times it was difficult to decide 
to drop the consideration of several challenging issues, interesting experi- 
ments, valuable investigations and innovations. 


PLAN OF THE BOOK 


The text divides into nine sections. Section I describes the historical back- 
ground out of which the examination reform programme eventually devel- 
oped. Section II provides an overview of the programme’s goals, areas 
and directions of work, operational strategy, and its review-evaluation 
procedures and their findings. 

Section JII deals with reforms in written examinations. After outlining 
the practical approach, it describes a brief ‘unit test? as one example of 
many which are widely used as formative-evaluation tools of diagnosis and 
remedial instruction. Section IV has, as its theme, reforms in the prac- 
tical examinations of science subjects. Besides describing the scheme for 


evaluating practical work, it includes the experimental try-out, supported 
by statistical data, from which this scheme emerged. 

Section V covers the reforms in oral examinations. Here there are two 
main schemes propounded by different schools of thought: (a) that ad- 
vocating orals for supplementary validation of the level of academic achieve- 
ment of pupils in subject areas already assessed by written and practical 
examinations; and (b) that proposing only the evaluation of oral expression. 

Section VI introduces the concept of ‘Prep Index’ (the Index of Pro- 
ficiency in an Educational Practice): a procedure for quantitative assess- 
ment of qualitatively conceived situations. It has proved to be a real 
breakthrough in this area of evaluation. The section shows how to evaluate 
educational pratices and compute the index, and is illustrated by a flow- 
chart. 

Section VII outlines one of the most important directions of our pro- 
gramme: we envisage the ultimate abolition of external examinations, and 
their replacement by assessments undertaken by the teachers. A scheme 
of comprehensive in-school evaluation, covering both the scholastic and 
non-scholastic areas of pupil growth, is described. This scheme is an 
outcome of three years of experimentation and try-out, and is fast catching 
on. The section also discusses evaluations in some new areas of the cur- 
riculum (such as health education, and work experience) which are being 

completely entrusted to the schools themselves. Section VII ends with a 
brief note on two autonomous schools established in 1975 in Rajasthan. 
The progress of this experiment is being watched very closely. 

Reforms in the mechanics of conducting examinations are the theme 
of Section VIII, which describes some innovations aimed at the qualitative 
improvement of examination procedure and practices. Section 1X looks 
at objectives in relation to curriculum, which have been set for examination 
reform programmes in the ten-year primary and lower secondary school, 
and in classes XI and XII of higher secondary education. 

A comprehensive bibliography is provided. 


THE REFORM PROCESS IN RETROSPECT 


In this Indian case study you will read of what we have been able to accom- 
plish so far in such a large country. Along the way, there have been many 
obstacles to surmount. For instance, I recall very vividly how difficult it 
was, at first, to negotiate with the states about getting our proposals imple- 
mented. Resistance to change was widespread, and appeared in many 
guises. On several occasions the state authorities, when approached, 
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politely asked us to try out our approaches in the ‘neighbouring state’ and 
to tell them the results. It proved a tedious task to discover this pioneer 
willing state until, in 1963, Maharashtra came forward. Then Rajasthan 
followed suit with comprehensive prospects of reform. After that, state 
after state indicated readiness to proceed, and projects were initiated in 
them (see Figure 1 at the beginning of this Introduction). 

The examination reform programme was by no means a standard one 
for all states. Different problems occurred in each. Whenever one problem 
had been solved, new ones tended to appear in the course of progress. 
All reforms are difficult, and examination reform is one of the most taxing. 
The impact that the programme in India has been able to make, with its 
acceptance by almost all of the states, testifies to the sustained efforts of a 
band of devoted workers who confronted resistances and problems with 
the resolve to overcome them. Their identification with the programme, 
and the pride they took in it, makes me feel confident that if ‘examination 
reform’ was animate, it would be proud of them. 


I. Historical perspective 


Ever since they were instituted, with the establishment of the Universities 
of Calcutta, Madras and Bombay in 1857, examinations have been under 
criticism. Their effectiveness, the purposes they serve, and their relevance, 
have remained controversial issues. 

Even the earliest of the reviews of education in India, dating from 1886, 
points out that the university entrance examination ‘matriculation’ has 
apparently stimulated the holding of at least six external examinations 
extending down to the lower primary stages. 

The Indian University Commission (1902) [22, p. 43]1, which also 
considered the matriculation examination and its effects, carried forward 
the recommendations of the Hunter Commission (1882) [20, p. 254] when 
it stated, ‘It is beyond doubt that the greatest evil from which the system 
of Indian university education suffers is that teaching is subordinated to 
examination and not examination to teaching.’ 

The Calcutta University Commission (1917-19) [24] recommended the 
creation of Boards of Secondary Education so as to end the domination 
of school education by the universities. Intermediate classes were also 
introduced as a buffer between the universities and secondary education. 
They were of two years’ duration after ten years of schooling and provided 
preparatory education for universities and professional education. This 
commission also identified several shortcomings in the examination system 
and specifically indicated its unhappiness about alternative questions, the 
mechanical system of marking, grace marks, frequency of examinations, 
and so on. 

The transfer of administrative responsibility for education from the 
British to the Indian Ministers in 1921-22, and the emergence of provincial 
autonomy in 1935, brought all the stages of education under the effective 


1. Numberings in the text are those of the main bibliography which begins on page 91. 


control of Indians themselves. This political development led to the 
establishment of Boards of Secondary Education in the states. The main 
function of these boards was to conduct external examinations at the 
school-leaving stage. Even though such boards began holding examinations, 
the matriculation examinations, which were conducted by the univer- 
sities simultaneously with the boards’ own, continued to dominate the 
scene. 

The Hartog Committee Report (1929) [25, p. 107] criticized the academic 
bias of examinations at the school level which continued to be geared to 
the needs of university entrance and provided no opportunities for the 
majority of students to take up industrial, commercial, or technical courses 
as a preparation for life. 

The report of the Central Advisory Board for Post-War Educational 
Development in India, known as the Sargent Plan (1944) [26, p. 20], again 
criticized the subordination of the high school curriculum to the requirements 
of universities, particularly in view of the fact that only one out of ten or 
fifteen high school leavers went on to a university. 


POST-INDEPENDENCE ERA 


After India became an independent nation, the University Education 
Commission (1948) was equally vocal in its criticism of examinations, 
stating that, if members were asked to make just one recommendation for 
reforming education, they would identify the area of examinations as the 
one where greatest priority and urgency for introducing reforms should 
be applied. 

Almost at the same time, the state governments became increasingly 
conscious about improving their systems of education. In 1948, the United 
Provinces (nowadays Uttar Pradesh) Government appointed a Committee 
on the Reorganization of Primary and Secondary Education [27, p. 54]. 
In the same year, a Committee on the Reorganization of Secondary Educa- 
tion was also appointed by the Government of Central Provinces and 
Berar [28]. Both committees deliberated on the problems of examinations 
in the context of education and suggested immediate action for reforming 
them. Soon afterwards, a Secondary Education Reorganization Committee 
(1953) [31] was appointed in Uttar Pradesh. This committee made the 
positive suggestions that external examinations might be replaced by an 
assessment made by the teacher, and that continuous evaluation could be 
the main basis for a final assessment of a student. We are still working 
to forward these aims. 


MUDALIAR COMMISSION 


The Secondary Education Commission, popularly known as the Mudaliar 
Commission (1952-53) [30, p. 237], made the following specific recom- 
mendations in regard to examination reform: 


1. The number of external examinations should be reduced, and the 
element of subjectivity in the essay-type tests should be minimized by 
introducing objective tests and also by changing the type of question. 


2. In order to assess the pupil’s all-round progress and to determine his 
future, a proper system of school records should be maintained for 
every pupil. These would indicate the work done by him during 
successive periods, and his attainments in each of the different spheres. 


3. In the final assessment of the pupils, due credit should be given to the 
‘internal’ (in-school) tests and the school records of the pupils. 


4. A system of symbolic rather than numerical marking should be adopted 
for evaluating and grading the work of the pupils in external and 
internal examinations, and in maintaining the school records. 


5. There should be only one public examination at the completion of the 
secondary school course. 


6. The certificate awarded should contain, besides the results of the public 
examination in different subjects, results of the school tests in subjects 


not included in the public examination; as well as the gist of the school 
records, 


7. The final public examination should be transformed into a system of 
compartmental examinations. These were conceived as supplementary 
to the main public examination. They provided an opportunity for 
students who had secured the minimum qualifying marks in most 
subjects, but had failed in one or two subjects by a small margin, to 
retake the examinations in the deficient subjects. 


THE ALL INDIA COUNCIL FOR SECONDARY EDUCATION 


After the Mudaliar Commission submitted its report, the Union Ministry 
of Education appraised these recommendations and began seeking ways 
of implementing them. For this purpose, the All India Council for Sec- 
ondary Education (AICSE) was established. The then Minister for Educa- 
tion, Maulana Abdul Kalam Azad, summarized the main functions of 
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this body as ‘an organization to advise the Government of India and state 
governments on the manner in which the recommendations of the commis- 
sion could be effectively implemented’ [34]. 

The AICSE started working on a variety of problems but soon realized 
that, to be effective, it should concentrate its efforts on a smaller number of 
specific priority problems. If therefore circulated a questionnaire to a 
large number of educational agencies and eminent individuals, to help 
determine priorities for a plan of action. From analysis of responses the 
following priorities in its various fields of work were identified: exami- 
nation reform; pre-service and in-service teacher education; curriculum for 
higher secondary schools; methodology, apparatus, and equipment for 
science teaching; administration and organization of multi-purpose schools. 

Without losing time, AICSE organized a seminar on ‘Examination 
reform’ at Bhopal, 22-29 February 1956. Besides other recommendations 
for improving examinations, the seminar also recommended the creation 
of an expert body—to be called the Central Examination Unit—to work 
in this specialized area. 


EXAMINATION REFORM AS A NATIONAL PROGRAMME 


The growing consensus among Indian educationists about the need for 
reform was receiving the active attention of the Ministry of Education, 
Government of India. The decision accepting Bhopal Seminar’s recom- 
mendation regarding establishment of a Central Examination Unit (CEU) 
was the earliest outcome. The next task became one of developing a com- 
prehensive plan of action for moving forward quickly and effectively. In 
doing so, the Ministry was eager to draw upon the experiences of other 
Countries as well as the expertise available at the national level. In 1957, 
it invited Dr. Benjamin S. Bloom, then Chief Examiner of the University 
of Chicago, to advise on the examination reform task. In the course of his 
brief stay in India, Dr. Bloom met with Indian educationists and educational 
administrators in different parts of the country and worked with about 
300 school and university teachers in seven workshops. He then assisted 
the Ministry of Education in developing the required plan of action. 
Due to a paucity of trained personnel to man the CEU, it could only be 
started on 13 January 1958 as a pilot unit with five officers within AICSE. 
Simultaneously, ten other educators selected from different parts of the 
country were sent for training in Curriculum and Educational Evaluation 
at the University of Chicago under Dr. Bloom. These officers (of whom 
the author is one) joined CEU in August 1958, when it became a full 
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fledged unit. It was with this event that the Examination Reform Programme 
took the form of a national movement. 

In 1959, AICSE and its Central Examination Unit were absorbed into 
the Union Ministry of Education. This occurred in a period when a sup- 
porting project of State Evaluation Units, sponsored and financed by the 
Ministry, was being initiated. In 1961, with the establishment of the 
National Council of Educational Research and Training (NCERT), the 
CEU became part of a body which already had a strong involvement with 
secondary education and which, in 1967, was given responsibilities for the 
improvement of primary education as well. By this time, too, several 
universities had approached CEU for help in reforming their examinations. 
NCERT’s reorganized and re-named Examination Reform Unit has func- 
tioned as such since 1974. 


KOTHARI COMMISSION 


The examination reform movement was given strong impetus when the 
Kothari Commission was established in 1964 by the Government of 
India [32]. This commission was different from the earlier ones as its terms 
of reference extended to all stages of education. It could, therefore, study 
India’s education system as a whole and, inter alia, give concrete recom- 
mendations on examination reform for all stages of education. The pro- 


gramme now being pursued is largely based on the Kothari recommenda- 
tions, which were as follows: 


1. The new approach to evaluation will attempt: (a) to improve the 
written examination so that it becomes a valid and reliable measure 
of educational achievement; and (b) to devise techniques for measuring 
those important aspects of the student’s growth that cannot be measured 
by written examinations. 


2. Evaluation at the lower primary stage should help pupils to improve 
their achievement of basic skills, and in developing constructive habits 
and attitudes. 

3. It would be desirable to treat classes I to IV as an ungraded unit. 
This would enable children to advance at their own pace. Where 
this is not feasible, classes I and II may be treated as one block divided 
into two groups—one for slow and the other for fast learners. Teachers 
should be appropriately trained for the ungraded system. 


4. At the higher primary stage, in addition to written examinations, an 
appropriate weighting should be given to oral tests as a part of internal 
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assessment. Diagnostic testing should be done through simple teacher- 
made tests. Cumulative record cards are important in indicating 
pupils’ growth and development. Even so, at this level they should be 
very simple and should be introduced in a phased manner. 


Although the first national standard of attainment is to be set at the 
end of the primary stage, it is not considered necessary or desirable 
to prescribe a rigid and uniform level of attainment tested by a com- 
pulsory external examination. However, for the proper maintenance 
of standards, periodic surveys of the levels of achievement in primary 
schools should be conducted by district school authorities, using 
refined tests prepared by state evaluation organizations. 


The district educational authority may arrange for a common exami- 
nation at the end of primary stage for schools in the district, using 
standardized and refined tests. This examination will have greater 
validity and reliability than the in-school examination, and will provide 
inter-school comparability of levels of performance. 


The certificate at the end of the primary course should be given by 
the school and should be accompanied by the cumulative record card 
and the statements of results of the common examinations, if any. 


In addition to the common examinations, special tests may be held 
at the end of the primary course for the award of scholarships or 
certificates of merit and for the purpose of identifying talent. 


External examinations should be improved by raising the technical 
competence of paper-setters; orienting question papers to objectives 
other than the simple acquisition of knowledge; improving the nature 
of questions; adopting scientific scoring procedures; and mechanizing 
the scoring of scripts and the processing of results. 


The certificate issued by the state board of school education on the 
basis of the results of the external examination should give the can- 
didate’s performance in different subjects for which he has appeared, 
and there should be no remark to the effect that he has passed or 
failed in the whole examination. The candidate should be permitted 
to appear again, if he so desires, for the entire examination or for 
separate subjects in order to improve his performance record. 

The student should receive a certificate also from the school, giving the 
record of his internal assessment as contained in his cumulative record 
card. This should be attached to the one given by the board. 


A few selected schools should be given the right to assess their students 
themselves. This would mean holding their own final examination 
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at the end of class X; one which will be regarded as equivalent to the 
external examinations of the state board of school education. The 
latter body will issue certificates to the successful candidates of these 
schools on the recommendation of the schools. A committee set up 
by the state board of school education should develop carefully 
worked-out criteria for the selection of such schools. The schools 
should be permitted to frame their own textbooks, and conduct their 
educational activities without external restrictions. 


13. Internal assessment by the schools should be comprehensive enough 
to evaluate all aspects of student growth, including those not measured 
by the external examinations. It should be descriptive as well as 
quantified. Written examinations conducted by schools should be 
improved, and teachers trained appropriately. The internal assessment 
should be shown separately from the external examination marks. 


14. During the transition period, higher secondary students will have to 
appear for two successive external examinations (at the end of classes X 
and XI) within one year. Where, however, the courses in classes IX 
to XI are integrated, the examination at the end of class X need not 
be insisted upon. 


FRAMEWORK OF CURRICULUM FOR THE TEN-YEAR SCHOOL 


Another historical landmark in education was the development of a 
curriculum framework for the ten-year school. This document has now 
received a national consensus and is a charter of directions for our future 
work. One of the sections of this document entitled ‘Evaluation and 
feedback’ spells out the targets we are aiming to achieve in the area of 
examination reform. It is in Section IX of this book [83, p. 697]. 


INTRODUCING VOCATIONAL CONTENT INTO HIGHER SECONDARY EDUCATION 


Details of the proposed evaluation scheme for classes XI and XII will 


also be presented in Section IX. Some introductory comments about the 
scheme are quoted here [84, p. 1]. 


The characteristic feature of the last two years of schooling (called Higher Second- 
ary) is to be diversification, a main aim of which is to avoid forcing students into 
the academic channel alone. Instead, it should offer them opportunities to choose 
subjects and programmes of study in a much wider field of education, in keeping 
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with their aptitudes, interests and abilities. As well as increasing their employ- 
ability, such diversification provides society with personnel having a wide spectrum 
of knowledge and training for its developmental needs. The scheme also aims at 
reducing the prevalent frustration among the youth which is an outcome of the 
non-productive and aimless education offered at present. 
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Il. Programme overview 


OVERVIEW 


Whatever their limitations, examinations have come to occupy a very 
dominant position in our education system. Be this as it may; the modern 
reform point of view asserts that they should, as a part of sound educational 
strategy, be wisely employed to bring about qualitative improvements in 
education. 

The Examination Reform Unit proposal envisages a programme aimed 
at delivering the learner from the disabling influence and irreversible judge- 
ments of an unfair examination system. The approach comprises a broad- 
fronted campaign to remedy the shortcomings of the traditional examination 
system: memorization was over-emphasized; coverage of the pupil growth 
process was limited; mercurial subjectivity was omni-present; inadequate 
use was made of test results; and receptivity to reform and change was 
discouraged. The traditional situation not only nullified all the criteria of 
a sound evaluation system, but also encouraged the adoption of slipshod 


methods of teaching and learning. Besides, it provided wide openings for 
malpractices to enter. 


APPARENT IMPEDIMENTS TO EXAMINATION REFORM 


The very term ‘reform’ envisages the existence of something to be changed. 
Reform is invariably a difficult task to accomplish, because the traditional 
procedures and practices have become deeply rooted in the system. In the 
process of examination reform, the following hurdles have been encountered: 
1. Inherent resistances to change: 


(a) by the State Departments of Education and Boards of Secondary 
Education. This is because examination reform involves a re- 
organization of the administrative machinery and procedures. 
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(b) by the teachers, because of their unpreparedness for taking up the 
challenges of the new system and because of additional work 
involved. 

(c) by the students, as post-reform examinations are likely to become 
valid and reliable, and will require more precise and regular study. 

(d) by unscrupulous elements, since malpractices are likely to lose 
ground as examinations are improved. 

(e) by vested interests which are desirous of maintaining a status quo 
which protects their powerful positions and (sometimes) financial 
gain. 

Lack of suitable sample evaluation material of a sort that provides 

illustrations of the nature of reforms envisaged. 

Lack of financial support, as the reform measures, in terms of over-all 

cost, tend to make the new examinations more expensive than the 

traditional ones. 

Inadequate training of the teachers for keeping up with the changed 

situation. 


Even though many other difficulties, problems and shortcomings pervade 
India’s system of education, those in the area of examinations are undoubt- 
edly very serious. They are not intrinsic to examination activities, but 
these are the ones which can be remedied through effective measures. This 
is a challenge to educators which also radiates hope. 


PROGRAMME GOALS 


Basic purposes 


External examinations under the reform programme were instituted mainly 
to serve the following purposes [57]: 


To act as a sort of quality control by delineating certain minimum 
standards for teachers, students and administrators. 


To help in finding out whether pre-set educational objectives have been 
achieved or not, and if achieved, to what extent. 


To help in assessing the strengths and weaknesses of students and, in 
that respect, help also to improve instruction. 


To help in diagnosing the effectiveness of teaching methods. 
To help in motivating students towards higher achievement. 


Li 


General objectives 
The major goals of the proposed programme of examination reform are 
to improve examinations so as to ensure: 


1. The value of examinations as valid and reliable measures of pupil 
growth. 


2. The pedagogical value of examinations, by making them powerful 
instruments for improving teaching and learning. 
In functional terms, these major goals imply: 


1. As far as possible, elimination of scope for examiners’ and workers’ 
subjectivity. 


Placing less emphasis on memorization. 
3. Discouraging selective study and selective teaching. 


Broader coverage of pupil growth in both academic and non-academic 
areas through the extension of the techniques of evaluation to oral 
examinations, practical examinations and other observational techniques, 
and through the use of a wider variety of tools like checklists, rating 
scales, interview schedules, inventories, and so on. 


5. Scientifically sound interpretation of marks. 


Functional and meaningful declaration of results for effective use by 
teachers, students and parents. 


Wider uses of test results for purposes of guidance, academic prediction, 
and curriculum evaluation. 


8. Improvement of the mechanics of conducting examinations. 


. Introduction of concomitant changes in instructional materials (text- 
books, teaching aids, etc.) and instructional methodology by harnessing 
the best teaching-learning situations and techniques. 


Specific objectives 


Efforts to achieve the goals of the programme are being applied to the 
multi-dimensional improvement of written examinations, practical exam- 
inations, oral examinations, and observational and other techniques. 


Though each of these fields of effort will be dealt with in detail, it seems 
appropriate at this point to highlight the salient features: 


1. Reform of written examinations [54, p. 119-39] mainly consists of 
improvements in: 
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(a) questions, by making them specific in terms of objectives, content 
and language; 

(b) question papers, by making them balanced in various aspects, by 
limiting options and by the provision of a detailed marking scheme; 

(c) scoring procedures, through the development and use of a detailed 
marking scheme. 

. Reform in oral examinations [140, p. 31-7] mainly consists of: 

(a) identification of the abilities and subject areas of oral expression 
that have been under educational development; 

(b) comprehensive coverage of the identified abilities/subject areas of 
oral examination; 

(c) improvement of objectivity in the assessment of these abilities/ 
subject areas. 

. Reform in practical examinations [127, p. 27-30] mainly consists of: 

(a) evaluation of proficiency in a wider variety of skills, by requiring 
a student to perform a number of small experiments instead of j al 
one big one; 

(b) evaluation of both the process and product of performance; 

(c) minimizing inter-examiner and intra-examiner variability in scoring, 
through the development and use of a detailed marking scheme. 

. Introduction and improvement in the vse of a wider variety of evaluation 

techniques and tools [103] through: 

(a) identifying areas of pupil growth, not covered through other tools 
of evaluation; 

(b) designing tools such as checklists, rating scales, inventories and 
observation schedules, for evaluating the above mentioned areas; 

(c) developing procedures of recording, classifying, analysing and 
interpreting the data so obtained, and of communicating these 
meaningfully; 

(d) developing procedures for the effective use of results of such evalu- 
ation; that is, to promote further growth of pupils’ understandings. 


PROGRAMME AREAS AND ASPECTS 


A wide variety of activities have been incorporated in the programme of 
examination reform, so as to attain its stated goals. There are several 
distinct categories of activity: 
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1. Research studies [70], investigations and experiments in the areas of 
external examinations and of school evaluation. 


2. Training and extension programmes in educational evaluation to orient 
key persons and staff in the examination reform programmes at state, 
national and international levels. 


3. Production of literature and evaluation material: 
(a) conceptual literature in educational evaluation [65, 66]; 


(b) sample evaluation material in scholastic and non-scholastic areas of 
pupil growth; 


(c) reports of workshops, seminars and conferences; 


(d) test library, consisting of an item bank, unit tests based on specific 
units of content in different subjects, and full tests (based on the 
prescribed syllabuses) for comprehensive examinations in different 
subjects for different classes. 


4. Co-ordination of nation-wide programmes of examination reform. 
This is an important function which is executed by the National Council 
of Educational Research and Training (NCERT) [46-52]. 


5. ‘Clearing house’ functions to disseminate information about examination 
reform projects, programmes and investigations within the country and 
abroad [104]. 


6. Consultative services to educational agencies concerning the develop- 
ment and implementation of their tasks in the programme of examination 
reform. 


THE SCALE OF PHASED PROGRAMME IMPLEMENTATION 


Making evaluation an integral part of the teaching-learning process and 
extending it beyond the narrow limits of academic achievement serves to 
bridge the gap between the school and the needs and aspirations of the 
society. For a successful implementation of the programme objectives it 
is necessary to change the attitudes of teachers, parents and pupils. 

The task involved in the reform process seems stupendous. The pro- 
posed changes will ultimately have to be introduced in more than 600,000 
primary schools, 100,000 middle schools, 40,000 high and higher secondary 
schools, 1,200 primary teacher training institutes, and 400 secondary 
teachers colleges. They will thus be directed to influence more than 2,500,000 
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AcGedchess’ a Bia number of supervisory staff, and a multitude of parents 
and pupils. Since such a large number of people are affected by the proposed 
changes, implementation was likely to meet with resistance from various 
quarters. A realistic strategy had to be developed, to help ensure that these 
changes occurred smoothly and were well co-ordinated with those in other 
components of the system. 

Changes in evaluation practices imply concurrent changes in courses 
and their objectives, instructional methodology, textbooks and other 
teaching aids, and teacher training (both pre-service and in-service). This 
necessity required simultaneous action on the part of different agencies and 
institutions responsible for running the education system. The organiza- 
tional and financial implications were considerable; therefore, long-term 
plans and projects for bringing about the necessary reform had to be 
developed. Allocation of adequate funds proved to be a major problem 
for the programme at the central and state levels. 

Because of the huge scale of the task, the examination reform programme 
is being implemented in a phased manner. As we have already seen, the 
total programme incorporates improvements in organizational as well as 
academic aspects of written examinations, oral examinations and practical 
examinations. In the first phase of the programme, attention was focused 
on improving the reliability of tests as well as their pedagogical value. 
Because statistical measures could only be applied when these examinations 
have been rendered adequately reliable, reform measures such as scaling, 
ensuring comparability of scores and so on were not introduced until the 
second phase. Several new innovations in the field are being planned for 
subsequent phases in the ongoing programme. 


HOW A PROGRAMME IS IMPLEMENTED 


In its collaboration with state educational agencies, NCERT normally 
undertakes the responsibility for training key personnel and in helping 
them to sample evaluation material for circulation within their institutions. 
The state educational agencies (departments, Boards and Institutes of 
Education; Councils of Educational Research and Training; evaluation 
units; university departments of education; and teachers colleges) attend 
to the printing and circulation of this material; the orientation of teachers 
and other allied activities; and measures related to the mechanics of con- 
ducting examinations. Up to now, the following states and union territories 
have sought and received NCERT's help in the development and imple- 
mentation of their programme: 
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STATES 


Andhra Pradesh 
Assam 

Bihar 

Gujarat 

Haryana 

Himachal Pradesh 
Jammu and Kashmir 
Kerala 

Madhya Pradesh 
Maharashtra 


Manipur 
Meghalaya 
Mysore 
Nagaland 
Orissa 
Punjab 
Rajasthan 
Tamil Nadu 
Tripura 
Uttar Pradesh 
West Bengal 


UNION TERRITORIES 


22. 


23. 
24. 
. Dadra and 


Andaman and 
Nicobar Islands 
Arunachal Pradesh 
Chandigarh 


Nagar Haveli 
Delhi 
Goa Daman Din 


. Laccadive, Minicoy 


29. 


and Amindivi Islands 
Pondicherry 


FIGURE 2. The states and union territories of India. 


The boundaries shown on this map do not imply endorsement or acceptance by Unesco. 


1. Andhra Pradesh 11. Maharashtra 
2. Assam 12. Manipur 

3. Delhi 13. Nagaland 

4. Goa f 14. Orissa 

5. Gujarat 15. Pondicherry 

6. Haryana 16. Punjab 

7. Himachal Pradesh 17. Rajasthan 

8. Karnataka 18. Sikkim 

9. Kerala 19. Tamil Nadu 

10. Madhya Pradesh 20. Uttar Pradesh 


The examination reform programme has emerged, then, as an excellent 
illustration of the central-state collaboration in the field of education. 

Eventually, in a particular state, the date for the introduction of the 
improved system of examinations is announced by the educational agencies. 
This announcement, in effect, notifies students and teachers to prepare 
themselves to meet the challenges of the examination reforms. 

Involvement of the teaching community in the programme is a most 
important ingredient for the success of the programme. Orientation pro- 
grammes for the teachers are planned and conducted by the state agencies. 
These assume an importance for the teachers and rouse their interest in 
learning the genesis of the envisaged programme and its practical impli- 
cations for them. 


PROGRAMME EVALUATION 


Programme evaluation is a built-in aspect of the strategy of the examination 
reform programme. Itis undertaken at each step. Comprehensive evaluation 
of the programme also occurs every three to five years. 


Continuous programme evaluation 


As a matter of policy, whenever a new scheme or project is planned, ‘status 
evaluation’ is the first step in the task. This is attempted through the 
checking of records and materials, questionnaires, interviews and on-the- 
spot study. 

In comprehensive evaluation, representatives of state-level educational 
agencies and experts in the field are involved, as well as NCERT personnel. 
The findings of these periodical evaluations of the schemes, projects and 
programmes are a constructive help in identifying areas of shortcomings 
and success. These studies invariably enlighten us about priority themes 
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for further research; aspects of training to be intensified or abandoned: 
types of literature and evaluation material required to be developed; the 
nature and mode of better co-ordination; and which consultative services 
should be provided for the effective implementation of the programme. 
The most recent of such reviews, for example, indicated that we need to: 


1. Conduct intensive studies on: (a) the operational aspects of our pro- 
grammes; and (b) the mechanics of conducting examinations. 


2. Develop literature for providing constructive help to teachers in the 
effective execution of projects under the new programmes. 


3. Develop more samples of evaluation material in the non-scholastic 
aspects of pupil growth. 


Try out some experiments in autonomous schools. 
5. Augment activity in the development of the NCERT test library. 


6. Explore the possibility of contemporary ideas like ‘open-book’ exam- - 
inations. 


These recommendations are being followed up in designing our forth- 
coming projects and programmes. 


It seems that no other educational programme has enlisted so much 
interest among the Indian public as the examination reform programme. 
In the press there are frequent references to our moves. This is yet another 
powerful source for giving us new ideas for further improvements. 


Programme evaluation by the Kothari Commission 


The NCERT examination reform programme was also evaluated by the 
Kothari Commission in the following words [32, p. 243]: 


During the seven years of its existence, the Central Examination Unit has made a 
multi-pronged attack for the popularization of the new concept and techniques 
of evaluation. It has worked with thousands of secondary school-teachers in 
seminars and workshops, introduced hundreds of training college lecturers to the 
new techniques, established a very large pool of test items, trained paper-setters 
attached to different Boards of Secondary Education, published a good deal of 
literature on evaluation, and carried out or sponsored several studies and investi- 
gations on various practical problems in examinations. As the work of this unit 
expanded, the Government of India approved the establishment of Evaluation 
Units in different states. 


It is also significant that the commission has not only appreciated the 
work of the Examination Reform Unit, but has also accepted it as a model 
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for undertaking a similar movement of examination reform at the university 
stage. The recommendation of the commission in this regard is as follows 
[34, p. 291]: 


There is need for a central source to guide and activate the movement of exami- 
nation reform, without which no early and effective progress is possible. For 
instance, the activity that one now sees in this matter in the state Boards of Sec- 
ondary Education is due largely to the Central Examination Unit in the National 
Council of Educational Research and Training. We recommend that the Univer- 
sity Grants Commission should set up immediately a similar examination reform 
unit for higher education at a sufficiently high level which would work in collabo- 
ration with universities. This could become a starting point of an effective pro- 


gramme or reform. 


SOME OUTCOMES 


The outcomes of the programme are many and varied. It is really not 
easy to compile all the data regarding them, particularly at the school level, 
where students are prepared for external examinations. However, some 
information is available in respect of external examinations conducted by 
various state Boards of Secondary Education. These have been summa- 


rized in Table 1. 


TABLE 1. Steps in examination reform introduced by various states and institutions. 


—— TT 
Steps in examination reform Introduced by the following states 
and institutions 


1. Development of policy statements Andhra Pradesh, Assam, Gujarat, 
(designs) for each question paper. Kerala, Maharashtra, Punjab, Raja- 
sthan, Council of Indian School Cer- 

tificate Examinations (CISCE). 


Appointment of paper-setters from Andhra Pradesh, Gujarat, Kerala, 
among those trained in evaluation. Maharashtra, Orissa, Rajasthan, 


n 


CISCE. 
3. Appointment of panels of paper- Andhra Pradesh, Assam, Gujarat, 
setters for each question paper. Kerala, Maharashtra, Rajasthan, 
CISCE. 


4. Allocation of definite proportion- Andhra Pradesh, Assam, Gujarat, 
ate percentages of marks in ques- Maharashtra, Kerala, Rajasthan, 
tion paper for testing different CISCE. 


abilities. 
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10. 


Ti. 


12; 


13. 


14. 


15. 


16. 


17. 


18. 
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Ensuring an effective coverage of 
the syllabus through the question 
paper. 


Introduction of specific pin- 
pointed questions in the question 
paper. 

Inclusion of short-answer ques- 
questions in the question papers, 
besides the essay-type ones. 


Introduction of objective-type 
(multiple choice) questions in the 
question papers. 


Use of question banks for setting 
question papers. 
Abolition of over-all options in the 
question papers. 


Development of marking scheme, 
accompanying each question paper, 
by the setter himself, 

Division of question paper into 
two separate sections for fixed 
response and free response ques- 
tions with fixed separate time 
limits. 

Introduction of centralized or 
spot-evaluation of scripts. 


Introduction of mechanical pro- 
cessing of examination results. 


Adoption of the system of giving 
grades instead of marks. 


Scaling of subject-wise results to 
make them comparable. 


Abolition of the system of declar- 
ing students as pass or fail. 


Allowing students to clear the 
examination in parts. 


Andhra Pradesh, Assam, Gujarat, 
Kerala, Maharashtra, Rajasthan, 
CISCE, Central Board of Secondary 
Education (CBSE). 

Andhra Pradesh, Assam, Gujarat, 
Karnataka, Kerala, Maharashtra, 
Rajasthan, CISCE, CBSE. 

Andhra Pradesh, Assam, Gujarat, 
Karnataka, Kerala, Maharashtra, 
Manipur, Orissa, Punjab, Rajasthan, 
Tamil Nadu, CISCE, CBSE. 

Andhra Pradesh, Gujarat, Karnataka, 
Kerala, Maharashtra, Manipur, 
Orissa, Punjab, Rajasthan, Tamil Nadu, 
CISCE. 


Gujarat, Rajasthan, CISCE. 


Andhra Pradesh, Assam, Gujarat, 
Karnataka, Kerala, Orissa, Rajasthan, 
CBSE. 
Assam, Gujarat, Karnataka, Kerala, 
Maharashtra, Punjab, Rajasthan, 
CISCE. 


Andhra Pradesh, Gujarat, Karnataka, 
Kerala, Punjab, Rajasthan, Tamil 
Nadu, CISCE. 


Andhra Pradesh, Assam, Gujarat, 
Karnataka, Kerala, Tamil Nadu, 
CISCE, CBSE. 


Andhra Pradesh, Gujarat, Karnataka, 
Kerala, Maharashtra, Rajasthan, 
CISCE, CBSE. 


Maharashtra, CISCE, CBSE. 
Gujarat, Kerala, CISCE. 


CISCE, CBSE. 


Andhra Pradesh, Gujarat, Karnataka, 
Kerala, Maharashtra, Punjab, CISCE. 


19. 


20. 


21. 


22. 


Permitting students to improve Andhra Pradesh, Karnataka, Kerala, 
their grades by appearing at Rajasthan, Punjab, CBSE. 

subsequent examinations. 

Reckoning both the product and Assam, Gujarat, Kerala, Maharashtra, 
performance in evaluation of prac- Punjab, Rajasthan, CISCE. 

tical work science subjects. 

Incorporation of both academic Rajasthan, Tamil Nadu. 

and non-academic areas of pupil 

growth in the scheme of internal 

assessment. 

Issue of separate certificate of Rajasthan. 

internal assessment along with 

that of external examination. 


LESSONS FROM EXPERIENCE 


During two decades of reform we have learned that some of the main bases 
on which a programme of examination reform should rest are: 


1. 


The desired changes to be brought about in children as a result of 
education ought to be clearly enunciated. These should not be confined 
merely to the areas of scholastic achievement but should cover non- 
scholastic areas of pupil growth as well. 

All educational efforts directed towards pupil growth need to be eval- 
uated in order to judge their effectiveness in bringing about pupil growth. 
Those who teach should test. Thus, we should place greater faith in the 
teacher and accept his assessment of the pupil for all practical purposes. 
An examination should become an instrument for promoting growth 
rather than simply measuring it. Its results should be used for diagnostic 
and prognostic purposes rather than merely for classification, grading 
and certification. 

An examination should not be considered as a multi-purpose tool. 
Special procedures and tools need to be developed for each specific 
purpose. Pupil evaluation and comparison of standards ought not to 
be attempted through a single examination. It is not desirable to make 
decisions regarding varied and dissimilar aspects of the personality on 
the basis of a single test. 

To be reliable, evaluation should become a continuous process occurring 


over a period of time. 
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A variety of procedures, techniques and tools ought to be evolved to 
suit the requirements of lifelong supplements to the school such as non- 
formal education. 


An examination should be conducted from the point of view of the 
individual rather than the examinating agency. 


External examinations, particularly at the secondary level, ought not to 
be crucial admission/rejection tests for jobs and higher studies (see 2 
below). 


Some practical directions with specific reference to external examinations 
also emerge. These are: 


1. 
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The declaration of examination results in terms of pass/fail and similar 
divisions has lost its significance and ought to be discontinued. Instead, 
a ‘clearance certificate’ awarded after having completed a course or a 
part of it may be given. 


Specially designed tests or procedures ought to be introduced for 
admission to courses of higher education and for selection to jobs. 


An examination should not be made a screening device for every purpose. 
Every student should not necessarily have to take an external examina- 


tion. Such examinations need only be taken by those who want to pursue 
higher studies. 


In an external examination, the hurdle of ‘simultaneous passing in all 
subjects, otherwise fail’ should not be imposed. Clearance certificates 
could be given as and when an individual succeeded in one or more of 
them. Examinees should, however, be in a position to obtain a com- 
prehensive certificate after clearing the minimum number of subjects. 
They should also have an opportunity of improving upon their grades in 
different subjects through subsequent attempts. 


The schemes of autonomous schools deserve a fair trial, To avoid 
complications, the boards may, as an interim measure, give their 
attestation to the certificate issued by the schools concerned. 


Measures may be taken to create a special climate against malpractices 
through the co-operation of the students and the community at large. 


Results may be declared in terms of grades (5 to 7 point scale) rather 
than marks. 


Declaration of results on the basis of raw scores should be discontinued. 
Suitable scaling procedures can be evolved and adopted instead. 


Ill. Reforms in written examinations 


In one form or another, examinations have always been an important part 
of the total educational process. Examinations are designed and adminis- 
tered at different stages of education and their results can be used for various 
purposes like grading, classification, certification, guidance, and so on. In 
all these situations they continue to be sources of motivation, whether 
positive or not, for the students and the teachers. 

Examinations in our country, external or internal, fall into three major 
categories: (a) written examinations; (b) oral examinations; and (c) practical 
examinations. Of these three, the written examinations, because they are 
most commonly used, play a very important role. They have developed 
some serious shortcomings which can be remedied with a little thoughtful 


effort. 


THE EXISTING SITUATION 


Prominent among these shortcomings are: emphasis on memorization; 
subjectivity; poor content coverage; and administrative shortcomings. 
We will examine how each of these shortcomings can be overcome and in 
what way their eradication will make evaluation better. 


Emphasis on memorization 


Until quite recently memorization occupied a dominant place in all written 
examinations, which almost completely overlooked the testing of higher 
objectives like understanding, and the application of knowledge and skills. 
This, in turn, reflected very badly on the instructional programmes where 
the development of these higher abilities on the part of the students was also 
invariably overlooked. 

The following corrective measures will help improve the validity of the 
question paper in terms of objectives, instead of rewarding examinees for 
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their rote memorization: (a) identification and definition of instructional 
objectives for the subject in question; (b) giving proportionate weights to 
each of these instructional objectives in preparation for framing questions 
which will test states of progress towards the objectives; (c) framing ques- 
tions of different forms which are most suitable for testing the abilities 
associated with the particular instructional objectives. 


Subjectivity 


Subjectivity within written examinations operates at three levels: (a) the 
subjectivity of the person who is setting a question paper; (b) the subjectivity 
of the examinee in writing answers; and (c) the subjectivity of the person 
who evaluates the answer books. 

It is symptomatic of many paper-setters’ subjectivity that we often find 
lop-sided question papers where some content areas are over-emphasized 
and other areas completely neglected. Indeed, sometimes questions have 
been set which do not synchronize with the course content and the text- 
books ! 

The subjectivity of the examinee operates when he is answering the 
questions. Very often, due to the vague wording of the questions, he 
interprets the dimensions of the expected answer in his own idiosyncratic 
way. This leads to a host of differences of approach to answering the same 
question. 

The subjectivity of the person who marks papers (and may or may not 
have set the examination) is also very dangerous, as it operates in a hap- 
hazard manner. In the absence of precise directions regarding the scoring of 
the answer scripts, he tends to judge the answers from the viewpoint of his 
own biases. He might even veer into recklessness in attempts to save time 
E among other preoccupations, to meet his examination reporting dead- 
ines. 

To prevent such shortcomings, the examining agency should develop 4 
design or policy statement of the question paper, and communicate it to 
the paper-setter. This design should give specific directions regarding the 
dimensions of the question paper and the considerations to be kept in mind 
while setting it. Such a design would indicate weightings according to 
objectives, according to areas of content, and the different forms of ques- 
tions that should be included. It should prescribe, too, the scheme of options. 
For example, these could be complete elimination of over-all options; OF 
options might be allowed only in essay questions, subject to the condition 
that they are comparable in respect of objective, content area, form, diffi- 
culty level, expected time for answering it, and so on. Finally, the design 
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should include directions regarding administration of the question paper. 
Another precaution against subjectivity is to require the setting of at least 
some questions which can be assessed objectively; that is, short answer and 
objective-type (multiple choice) questions. Furthermore, questions should 
be worded specifically so as to delimit the scope and length of the expected 
answer. 

It is most important that the paper-setter should prepare a scoring key 
and a detailed marking scheme as he completes setting the question paper 
itself. The key and marking scheme have to be supplied to all the paper’s 
examiners to guide them in scoring answer scripts. Preparing a scoring key 
and marking scheme while one is setting the question paper helps the setter 
to detect many mistakes in the questions which could otherwise go un- 
noticed. A detailed marking scheme, giving the value points in terms of the 
outline of the expected answers, will reduce inter-examiner variability to a 
minimum. Notwithstanding all the care that has to be taken by the paper- 
setter, a most important pre-requisite will still be that the key and marking 
scheme are used, and appropriately so by each examiner for purposes of 


Scoring. 


Poor content coverage 


Formerly, ineffective coverage of the content by question papers had become 
such a common feature that nobody seemed to take any serious view of it. 
This phenomenon was unmistakably impairing the entire teaching-learning 
process. It exerted undesirable influences by encouraging selective study on 
the part of the students and selective teaching on the part of the teacher. 

Measures to ensure an effective coverage of content through a question 
paper are: (a) to define the major areas of content, giving proportionate 
weights to each of them when framing the series of questions; (b) to include 
numerous short answer and objective-type questions; (c) to restrict the 
numbers of options, retaining them only in the essay-type questions, and 
ensuring their mutual equivalence as alternatives there. 


Administrative shortcomings 


Even when there is excellent paper-setting and marking, the value and 
success of the examination can still be spoilt by poor administrative pro- 
cedures when the examination takes place. Advance precautions to be 


taken in this regard include: 


31 


1. The division of the question paper into two parts: Part A consisting of 
fixed-response questions, and Part B, free-response questions. 


2. Both sections may be handed to examinees simultaneously, but Part A 
will need to be collected earlier, after the expiry of a specified time 
limit—say half an hour or so. This will prevent students from getting 


opportunities to copy from others’ scripts, which is very easy in respect 
of fixed-response questions. 


3. In administrative matters, giving precise directions to the setters for 
setting and to the examiners for scoring the question papers. 


A COMPREHENSIVE PLAN OF ACTION 


The foregoing discussion has focussed on several prevalent defects and how 
to overcome them. The general plan of action that emerges can now be 
sketched. 

A question paper is not and ought never to be treated as just a random 
assortment of questions. To be an effective instrument of evaluating aca- 
demic achievement it has to be structured according to a pattern decided 


in advance. The following steps are necessary for setting good question 
papers. 


Preparation of a design for a question paper 


Design is not only the first, but also the most important step in paper 
setting. It lays down the chief dimensions of the question papers and, in 
that respect, is a policy statement. Its various parts are: 


1. Weighting among objectives. This means selecting the learning objectives 


to be tested, and allotting marks to each in terms of their relative impor- 
tance. This will help reduce emphasis on memorization and enable due 
emphasis to be given to the testing of higher abilities. 


Weighting among different areas of content. This entails analysis of the 
syllabus beginning with the delimitation of the scope of each topic, and 


then the allotment of marks to each of the major areas for the purpose 
of framing questions. 


Weighting for different forms of questions. Working on the principle 
that, for testing a particular ability and content, the most suitable form 
of question should exclusively be used, we may wish to choose different 
forms of questions for inclusion in the question papers instead of just 
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one single traditional form, such as the essay type. The marks to be 
allotted to each form used have also to be decided. 


4. Scheme of options. As discussed earlier the design may also indicate the 
pattern of options. This may represent the complete elimination of 
over-all options and the limited retention of internal options. Among 
themselves, the latter should be comparable in respect of the learning 
objectives to be tested, the major area of content covered, the form and 
difficulty level of the question. 

5. Sections in the question paper. The inclusion of fixed response questions 
(short-answer and objective type) may require the division of the ques- 
tion paper into sections and the allotment of a time limit for answering 
the fixed-response section. As explained earlier, these questions are 
usually answered quickly and need not remain with the pupils for longer 
than the reasonable time allowed for attempting them. 


Preparation of a ‘blueprint’ 


The ‘blueprint’ is a detailed plan based on the design for preparing a ques- 
tion paper. It is a multi-dimensional chart giving the placement of the 
different questions in respect of: (a) the objective tested by each; (b) the 
content area covered by each; (c) the form of question which is most suitable 
for testing (a) and (b). : 

In addition to the above three dimensions, the blueprint may also 
indicate: (d) the numerical weight given to each question individually; and 
(©) the scheme of options to be adopted in framing the questions. 


Preparation of questions based on the blueprint 


After the specifications of all the questions have been included in the blue- 
print, the next step is the preparation of the questions themselves. Each 
of these questions has to be framed to satisfy the requirements of its respec- 
tive position in the examination plan. 
The framing of questions based on 
learning objectives and specifications, 


skill in framing different forms of questions. N 
While writing or selecting questions the paper-setter must keep in mind 


that: (a) each question is based on a well-defined objective; (6) it relates to 
a specificcontent area; (c) it is written in the form required by the blueprint 
and satisfies the rules for framing that form of question; (d) it is at the desired 
level of difficulty; (e) each question is so worded as to be well within the 
comprehension of the pupils, and that it clearly indicates the scope and 


the blueprint calls for knowledge of 
mastery of the subject matter, and 
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length of the answer; (f) it is so worded in the original language that its 
scope, meaning and difficulty level will not change in the process of trans- 
lation; (g) it has good discrimination value. 


Editing the question paper 


Editing the question paper is a step of crucial importance. It consists of the 
following procedures: 


1. Assembling the questions into sections is usually done on the basis of 
their form. That is, the fixed-response type of questions may be put in 
one section and the free-response type questions in another. Within 
each section, again, there could be sections based on the content area 
divisions, if necessary. Whether there are sub-sections or not, the ques- 
tions are to be organized in a graded order of difficulty from easy to 
difficult. Such a grading gives examinees confidence in their ability to 
attempt the questions and reflects the complexity of the mental abilities 
required. 

2. The instructions to examinees need to be clear, specific and pointed. 
General instructions should be given at the beginning of the paper, and 
specific instructions related to each section should appear at the head of 
the corresponding section. 

3. Implications Jor administration. Editing may have important implica- 
tions for the administration of the question paper. For instance, in view 
of the division of the question paper into sections based on forms of 
questions, it may be necessary to give a specific time limit to the section 


containing fixed-response type of questions. This will help to reduce the 
opportunities for malpractice. 


Preparation of the scoring key and the marking scheme 


Very often, when we start thinking of the answers to particular questions we 


discover mistakes in the present phrasing of questions; so it is essential to 
frame the scoring key and the marking scheme concurrently with the 
framing of the question paper. 

The scoring key is to be prepared for the objective-type brief questions, 
and the marking scheme for the essay and short answer questions. The 
marking scheme gives the expected outlines of the answers and the marks 
that each point or aspect of the answer deserves. In case there are more 
points than provided for in the marking scheme, and the student has the 
freedom to choose only a limited number of them, it could be indicated that 
any combination of the valid points up to the required number may be 
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taken as correct. As far as possible, then, all the answer points that may be 
Televant to the question should be listed in the marking scheme, irrespective 
of the number asked for in the question. Detailed instructions for scoring 
will also need to be worked out and issued to the examiners. 

This will ensure a high degree of reliability in scoring by an examiner 
and uniformity in scoring when many examiners evaluate answer scripts. 


Preparation of the question-wise analysis 


The question-wise analysis will enable us to know the strengths and weak- 
nesses of our question paper more thoroughly. It will also give us a check to 
compare our question paper with the design and the blueprint. Each ques- 
tion will be analysed in terms of the following elements: (a) objective tested 
by the question; (b) specification on which the question is based; (c) topic 
Covered by the question; (d) sub-topic covered by the question; (e) form of 
the question; (f) estimated difficulty level (easy, average or difficult); 
(g) approximate time required for answering; (A) marks allotted to the 
question. These details could be given in a tabular form. If so, each column 
of the table can be summarized to give us the distribution of questions, 
either over the different objectives, or the areas of content, or the forms of 
questions, 

The question-wise analysis can also be undertaken in a different form; 
that is, resembling a blueprint, by indicating the serial number of questions 
within the cells for which they satisfy the dimensions of the blueprint. This 
Should tally exactly with the design and the blueprint and is the best way of 
checking that the questions fill the places located in the original blueprints. 


Administrative steps [15, p. 529] 


The scheme as outlined above is in vogue in several Indian states. For its 
Successful implementation, the following specific measures have been taken 


by the examining agencies: 
l. Training of paper-setters and other resource persons with the help of 


NCERT. , 
2 Development of sample evaluation material by trained persons on the 


lines indicated. . . ; 
3. Circulation of brochures of sample evaluation material (question 


Papers and units tests) to schools. l 
4. Orientation of teachers so that they can prepare their students for the 


improved type of examinations. 
35 


The date for the introduction of the improved examinations is announced at 
least two years in advance to enable appropriate preparation. The necessary 
changes in rules and regulations of the examining agencies are also made 
wellin advance. The entire machinery has to be made ready for the improved 
examinations. ` 


A UNIT TEST 


To illustrate an outcome of the Plan of Action, an example of a unit test in 
physics is given. The unit on ‘reflection’ from the area of ‘light’ is the theme 
of this test. While the example has all the other characteristics of a full ques- 
tion paper it is not divided into two sections as a question paper is. This is 
because it is meant for administration during a class period. Such ‘unit 
tests’ are widely in use in the country as a tool of ‘formative evaluation’ for 
purposes of diagnosis and remedial instruction. They also help train students 
for taking the improved comprehensive external examination [90]. 


Unit: Reflection 


Time: 40 minutes 
Class: IX/X 


Maximum marks: 25 


A. DESIGN OF THE UNIT TEST 
1. Weighting by objectives 


u —— 


3. Weighting by form of question 


Objective Weighting Form of question Weighting 
Acquisition of knowledge 8 
Development Objective type 3 
of understanding 10 Short answer type 2 
Application of knowledge 4 Essay type ? 
Development of skills 3 


Total marks 25 
Total marks 25 


2. Weighting by areas of content 


ee 


4. Pattern of options 
Area of content Weighting yop 

Reflection at a plane mirror 9 Noioptions. 
Reflection at a concave 

mirror 7 
Reflection at a convex 5. Scheme of administration 

mirror 9 

To AE site JA 
Total maks 25 be administered within 


class period. 
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B. BLUEPRINT 
Unit: Reflection 


Time: 40 minutes 
Class: IX/X Maximum marks: 25 


Objectives 
Knowledge Understanding Application Skill 
E SA OT E SA OT E SA OT E SA OT Total 
Reflection at a plane mirror 1(1) 1(1)* Ky \ 9 
1()* 2X2) 21) 1()* f 
Reflection at a concave mirror 1(1) 2(1) 2(2) 2(2) 7 
Reflection at a convex 
mirror 4(1)* 2(1) 2(1) ic}* 9 
Sub-totals 41) 20) 22) =- 64) 44) - 271) 2Q) WY 26). = 25(15) 
Grand total 8 10 4 3 25 


NOTE: Figures within parentheses indicate the number of questions, and figures outside the parentheses indicate marks. 
E = essay-type questions; SA = short answer questions; OT = objective-type questions. 
* Indicates that skill is connected with knowledge or understanding in the same question. 


Cc. TEST 


Class: X/IX Time: 40 minutes 
Maximum marks: 25 

INSTRUCTIONS 

A. All questions are compulsory. 

B. Read the question carefully before trying to answer it. 

C. Answers have to be written on the answer book provided. 

D. Be quick in answering the questions. 

E 


. Do not waste time on a question if you are not sure about the answer. 
Pass on to the next. 


F. In questions 1 to 8 there are five answer alternatives marked A, B, C, D 
and E. Only one of these answers is correct or best. The letter indi- 
cating the correct or best answer should be written in bold letters 
against the question number in the answer book. 

G 


. Questions from 1 to 8 carry 1 mark each. The remaining questions carry 
2 marks each except for question no. 14, which carries 5 marks. 


A ray of light makes an angle 0 with a plane mirror. The angle of reflection 
will be 
A. 0 
B. 90-6 
C. 90+6 
D. 180—909 
E. 1804+90 I% ? 
A ray of light is incident at an angle a on a plane mirror. The angle of devia- 
tion suffered by the ray will be 
A. 2a 
B. 90— a 
C. 180— a 
D. 180— a 
E. 180— 2a 2( ) 
An object is placed between two plane mirrors inclined at an angle. The 
number of images formed is 19. The angle of inclination between the mirrors 


is 

A. 24°. 

B. 19°, 

C. 18°; 

D. 12, 

E. any angle. 3() 
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. The image of an object placed below the principal focus and centre of cur- 
vature of a concave mirror is 


A. erect, magnified and virtual. 

B. erect, diminished and real. 

C. inverted, diminished and real. 

D. inverted, magnified and real. 

E. erect, magnified and real. 4( ) 


. The image of an object formed by an optical instrument is magnified, erect 
and virtual. This optical instrument is 


A. a concave mirror. 
B. a convex mirror. 
C. a concave lens. 
D. a prism. 

E. a plane mirror. 


5( ) 


. An object is placed 20 cm. away from a concave mirror of focal length 10 cm. 
If the object is 10 cm. long, the position and size of the image will be 


Position Size 


A. 25 cm. 20 cm. 
B. 20 cm. 10 cm. 
C. 20 cm. 20 cm. 
D. 15 cm. 10 cm. 
E. 10cm. 20 cm. 6( ) 


The distance of an object and its image from the focus of a concave mirror 


are 8 cm. and 32 cm. respectively. The focal length of the mirror is 


A. 8cm. 

B. 12 cm. 

C. 16 cm. 

D. between 16 and 20 cm. 

E. none of the above. 7 } 
centre of curvature of a concave mirror of 12 cm. 


An object is placed at the 
A hifted towards the focus by 4cm. The size of the 


radius. Then the object is s 
image now is 

. three times the object. 

double the object. 

same as the object. 

. half the object. 

one-third the object. st $ 


monaw» 


E: Pe « > 
(a) Define the terms ‘principal axis and ‘centre of curvature’ of a convex 


mirror. 


(b) Explain why the convex mirror is used by automobile drivers. 
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10. The distance between an object and its image formed by a convex mirror is 
36cm. The image is half the size of the object. Find the focal length of the 
mirror and also its distance from the object. 


11. In the following diagram, OP is the object and IQ is its image. Find the focal 
length of the concave mirror. 


10cm. 


€----------> 
£ 


Q 


12. Two plane mirrors are inclined at an acute angle such that a ray of light 
coming parallel to either of them retraces its own path. Draw the required 
diagram and calculate the angle between the mirrors. 


13. A candle (L), a plane unsilvered glass (M) and a blackened wooden box (B) 


covering three sides of the burning candle are given below. Copy the sketch 
in your answer book and show the position of the eye and the direction of the 
rays so that a person can see the candle burning in water in the beaker (G). 


P S deo & 
14. Deduce the relation = oS F for a convex mirror. Draw a neat necessary 
diagram. 
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D. SCORING KEY 


Questions no. 1 2 3 4 


5 


6 


7 8 


Key BACDABCA 


Questions 1 to 8 carry 1 mark each 


Q. no Value points Marks Total 
for each 
9. (a) Definition of principal focus VA 
Definition of centre of curvature. % 
(b) Reasons 1 2 
10. Focal length 24 cm. 1 
Object distance from the mirror 24 cm. 1 2 
1. Calculation v (30 cm.) % 
Using the fi a Y 
ing the formula — + 7 = 2 
Finding the focal length 7.5 cm. 1 2 
12, Correct diagram. 1 
1 2 


Angle of inclination 45°. 


13. Correct diagram as follows 


Position of eye 
Direction of rays 


1 5 
4. Deduction of formula 
Necessary diagram 
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IV. Reforms in practical examinations 
for science subjects 


INTRODUCTION 


While the examination reform programmes for different school subjects 
were being envisaged, it was realized that work in the area of science 
Subjects would remain incomplete if practical work were not included in 
the range of reforms [68; 127, p- 27-30]. 

The sixth conference of the Chairmen/Secretaries of the Boards of 
held in 1964, deliberated on this problem in great 
depth and passed a resolution that the boards, in collaboration with the 
Examination Reform Unit (then called Central Examination Unit) of 
NCERT, should take up work in this area. Shortly after the conclusion 
of the conference, the Rajasthan Board of Secondary Education got in 
touch with NCERT in order to launch a programme in this area. One was 
duly developed, and a series of experimental try-outs were undertaken to 
evolve an improved system of practical examinations. The Rajasthan 
Board implemented the new plan in its Higher Secondary Examination of 
1968 in the subjects of physics, chemistry and biology after making adequate 
change-over preparation in collaboration with NCERT. 

We will now give a brief résumé of the experimental study conducted 
for the development of an improved pattern of practical examinations in 


Science subjects, and for its large-scale implementation. 


Secondary Education, 


SHORTCOMINGS OF THE TRADITIONAL PATTERN 


A qualitative study based on verbal reports by a number of experienced 
of the country revealed that the traditional 


examiners in different parts j v 
Pattern of practical examination in science subjects suffered from several 


major shortcomings: 
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Poor sampling 


Because each experiment then being given was very complex, comprehensive 
and time consuming, only a few experiments (e.g. two in physics) could be 
undertaken in the limited time available. As such, they could only measure 
a small fragment of the content and a few of the many aspects of skill that 
practical work is expected to develop. These limitations reduced both the 
validity and reliability of the practical examinations. In practice, therefore, 
the pattern was very discouraging to the pupil as well as to the teacher, 
especially on account of the excessively high chance factor operating in such 
a system. 


Absence of reliable assessment criteria 


The criteria of assessment were very general, and examiners were assessing 
the performance of students according to varied individualistic standards, 
leading to loss of consistency and uniformity. 


Non-comparability of experiment exercises 


The exercises varied so much in complexity and the nature of skills involved 
that it was not justifiable to attempt a comparison. The performance/ 
proficiency of two individuals can only be compared when the ability and 
content tested, the level and difficulty, and the time required are comparable. 

In the traditional pattern of practical examinations for science subjects 
only one or two experiments were given to each student. Since equipment 
in schools was often limited, the same experiment could not be performed 
by all the students. It was thus a matter of chance which experiment fell 


to which student. And the experiments that were allotted to each student 
were compulsory. 


BASES FOR A NEW PATTERN 


Practical tests are relatively costly and time-consuming: thus it was felt 
that they should be used only when other more convenient techniques such 
as written tests could not be used. In science subjects, it is in the realm of 
practical skills that written tests are not usable. Hence, practical tests 
should essentially be used to measure practical skills, although other 
objectives such as knowledge, understanding, or application need not be 
entirely overlooked. For this purpose, practical skill was conceived as a 
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Br eats 

aoe of two components: (a) the process of performance; and 

ae € product of performance. These two components were further sub- 
ivided in respect of each subject, to delimit their scope. 


Process of performance 


The pupil: 


N+ 


art nn fw 


Selects appropriate apparatus, tools, etc. ; 

Checks apparatus, tools and other equipment, to ensure that they are 
In working order; 

Detects errors and limitations in the fitting up of apparatus; 

Rectifies errors, if possible, under laboratory conditions; 


Cleans apparatus, tools, etc.; 
Sets up apparatus, tools, etc. ; 
Sketches arrangement of apparatus 


Prepares and follows a systematic a 
observations; 


(if necessary, at the outset); 
nd sequential plan for taking 


States the principle or formula (explaining the symbols and so on, 


which are pertinent to the experiment); 
while performing the experiment; 


Manipulates apparatus, tools, etc., 
ments and other indi- 


Measures quantities and accurately reads instru 
Cators; 


Takes precautions in handling instr 
Makes accurate observations of parts, S. 


Records observations, and makes calcul 


uments, equipment and materials; 
pecimens, processes, and so on; 


ations where necessary; 


Verifies observations; 
Performs experiments with reasonable speed; 
Performs experiments with reasonable accuracy; 
Performs experiments with neatness; 
Adapts himself with somewhat new and different ap, 
Novel experiments; 

es, etc., involved in the experi- 


Explains orally the procedures, principl 
ments, 


paratus in setting 
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Product of performance 


The pupil: 

1, Summarizes observations; 

2. Calculates and finalizes the results; 

3. Interprets data and draws conclusions; 

4. Records experimental procedure and conclusions; 

5. Dismantles and cleans the apparatus, where necessary; 
6 


Arranges the apparatus, equipment and materials in their appropriate 
places at the end of the work. 


Sessional practical work 


The practical exercises performed by a pupil in the secondary classes are 
recorded in specially developed record books. The skills and traits attained 
while performing these exercises also deserve to be evaluated as a part of 
practical work in science subjects. It may not be possible and perhaps not 
desirable to evaluate all the traits developed, but a few like ‘completeness’, 
‘neatness’ and ‘regularity’ do deserve the attention of the evaluator. 

Some of the skills that may be appraised from this aspect of practical 
work are: (a) drawing of diagrams and sketches from observed facts; 
(b) collection of specimens like ores, minerals, crystals, etc.; (c) display of 


material collected; (d) improvisation of simple apparatus; and (e) construc- 
tion of models. 


DEVELOPMENT OF NEW PATTERN 


For the purpose of improving their validity and reliability, the practical 
examinations were modified in the following respects: 


Increasing the number of exercices 


Instead of giving a few long exercises, many short exercises were introduced. 
For example, in physics one of the two major comprehensive experiments 
was retained and the other one replaced by four or five short exercises. 
The maximum marks and the time, however, were kept the same. 


Making the exercises objective-based 


Exercises were set to test 


; pre-determined specific aspects of skill (or under- 
standing), as laid down i 


n the educational objectives and as defined as part 
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of the process and 
Une product of performance. This tended to i 
validity of the practical examination. la 


I s z 
mproving scoring procedures 


Ya Seo marking schemes, giving minute assessment data of pupils 
T ie anen were developed not only for major and short exercises but 
aai ssional work and orals. Detailed instructions for the use of exam- 
ee candidates were also developed. ; This helped in improving the 
ia BS a scoring and controlling reliability by minimizing the variability 
likes sh a (emerging from extraneous factors like personal 


Improvi ‘ 
proving the reporting and interpreting procedures 


De i š . 
eae instructions were developed for the use of examiners. When these 
rts are properly used by schools, science teaching will be improved in 


many respects. 


E 
XPERIMENTAL TRY-OUTS 


Wee examiners for each of the subjects of physics, chemistry and biology, 
eden involved in the development of the new pattern, tried out these 
Brih ures three times under examination conditions especially arranged 
thira P purpose. In the first try-out ten candidates, and in the second and 

i fteen to twenty candidates, were involved in all three subjects. 
uring each try-out the four examiners observed simultaneously and marked 


in 5 . ; 
dependently. The experience of an earlier try-out was always invariably 
the scoring schemes of the sub- 


Use . . 

as d to improve the exercises and to refine 

hae try-outs. The results of assessment were then studied and correla- 
ns found. The findings in the try-outs of biology are given in Table 2 as 


ani Š ž x 
n illustration. The results are comparable with those for the other subjects. 
ets of examiner inter-correlations in 


Tap 
LE 2. Comparative study of three s 
n three try-outs. 


biology: practical examination i 


A, 
Averaged across question 
BC BD CD N 


E: 2 
Xaminer|try-out AE AC AD 
i 78 65 67 83 74 68 12 
94 95 95 92 94 93 15 
99 99 15 


B. Based on total test scores 


Examiner|try-out AB AC AD BC BD CD N 
È .89 .88 .59 -78 82 63 12 
Il. 87 45 .84 255 90 45 15 
il. 97 99 98 98 98 97 15 


aaee 


C. Based on ranking of difficulty indices of questions 


Examiner|try-out AB AC AD BC BD cD N 
Ñ -88 .90 .90 .98 .78 315 9 
Il. 93 1.00 98 93 97 98 9 
Ill. 98 1.00 1.00 98 98 1.00 9 


e E E ee ee a ee 8 ee ee 
Significance levels of rhos: 
When N= 9: .05 = .600; .01 = .783 
When N = 12: .05 = .506; .01 = .712 
and When N = 15: .05 = .439; .01 = .623 


— aaiiaeaaaaaaalalalalaaaaasssssssssasasososostltll 


ll 


In this subject (biology), during the first try-out three out of six examiner 
inter-correlations are not significant at the .01 level but are significant at 
the .05 level. The agreement among the examiners in try-out II is at or above 
.92. All the inter-correlations substantially increased in try-out II. Again, 
in try-out III, the examiner inter-correlations averaged across the questions 
reached unity in 3 out of 6 cases, and in the rest they are at .99. Thus the 
inter-examiner agreement in biology practical tests reached almost the 
optimum level as a result of intensive training, practice and development of 
well-designed scoring procedures. 


IMPLEMENTATION OF THE SCHEME 


Preparation 


Encouraged by the above findings, the Rajasthan Board decided to launch 
the reform programme on a large scale throughout the state. It developed 
brochures for each subject, entitled ‘Improved pattern of practical examina- 
tion’, with the help of NCERT and the examiners who had participated in 
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the try- i 

rd a minare them to schools. The board also trained all 

SD sancti Lag coe of practical examination in these three science 

aban eave spe ay workshops organized for the purpose, they were 

A Shien heory of conducting the examinations. They acquired 

E ice in conducting the new-type practical tests in actual 
, which were specially arranged at various places as a part of 


the training programme. 


I; 
mplementation 


With th 
ese and other preparatory steps carefully executed, the board intro- 
mination of 1968. Its 


duced 
Bais new pattern in the Higher Secondary Exa 
school practices has been found to be quite encouraging according 


t 
© the follow-up studies. 


Some problems 


Duringi 
ng 1 ” E 
g implementation, some problems were encountered which had already 


e x 
en envisaged. 


Loh 
tes o ee laboratories. Ma 
tion ie a want of these, it became 
Sonis tah ively. This was also true o 
trained oratories, too, did not have 
Nu assistants are essential. 
fon candidates per examiner. The new pattern envisages close 
fierce ion of pupil performance during the period of examination. 
ae aminer obviously cannot cope with forty candidates at a time, 
present. Perhaps twenty may be @ manageable number. 


Trai 
th ined examiners. Not only in the initial stages, but continuously 
ve to ensure that examiners are ac- 


ere: 

quai after, the authorities will ha t xaminers a! 
fhe ed with the new pattern of examination, including its spirit and 
nique, before they are entrusted with the job. 


ny schools did not have good labora- 
difficult to conduct the new examina- 
f the old pattern of examination. 
trained assistants. Services of 


Imp); 
eo 
Or the 

Will be Sn of this new examination, co-operation 

dicate betes Some implications of the scheme for suc 

D ‘ 

partments of Education and Boards of ‘Secondary Education: (a) school 
Oratories will have to be better equipped; (b) syllabuses of practical 


from different agencies 
h agencies are 
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work in science subjects may need to be reviewed; (c) flexible timetabling 
will have to be permitted ; (d) better inspection and guidance programmes 
will have to be developed; (e) only qualified and trained examiners can 
be selected; and (f) examiners’ reports will have to be scrutinized and 
the findings reported to schools for action. 


2. Schools: (a) greater initiative on the part of individual teachers and 
pupils will be needed; (b) rigidity of timetables will have to be reduced; 
and (c) the evaluation data should be used for remedial and improvement 
actions. 


3. Teachers: (a) variety of practical activities will have to be designed and 
organized to develop specific skills among pupils and to discourage the 
tendency of mechanical repetition of standard experiments; and (b) ini- 
tiative on the part of pupils will have to be encouraged. 


CONCLUSION 


Practical work in science subjects is aimed at achieving some specific pur- 
poses, which cannot be otherwise realized. Practical examinations, therefore, 
have to be so planned that they measure the degree of success achieved by 
practical work, as a contribution towards the multi-faceted development of 
pupils’ innate powers and subsequent achievements. The new pattern 
suggested here aims at this. It defines the outcomes of the process and the 
product of performance, stresses the need for developing valid and reliable 
tools of measurement, and has built-in ways to evaluate the results of mea- 
surement. It also envisages sound feedback procedures to utilize the results 
of evaluation in improving school practices. It is hoped that, given a fair 
trial, this pattern will work as a catalytic agent in making science education 
a dynamic process and a creative activity in our schools. 

The scheme, as described, has attracted, the attention of science teachers 
and experts and is acknowledged to be of great help in their effort to make 
evaluation of practical work an integral part of science teaching. They are 
increasingly using this approach. 
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V. ` 
Reforms in oral examinations 


INTROD 

UCTION 

no longer a matter 
f thought in India 
ions. One of the two 


y of evi A 
E pete obtained through ot 
Mostly of eames examinations. The other sc 
emphasize t} nguage teachers, believes that an oral examination should 
aspects like he assessment of oral expression only, 
o language, pronunciation, grammatical correctn 


ASSEg 

SING 

Ad KNOWLEDGE OF CONTENT AREAS THROUGH ORAL EXAMINATIONS 

Vocat 
es A 2 ; 

: Oral 2 the first-mentioned school support their viewpoint by stating 
now eee aS provide an excellent opportunity for evaluators to 
isely what an examinee actually knows on a particular subject 


Ou 
S t which he > > ` i 3 
ay be questioned. They emphasize that oral examinees 
the examiner's line of inquiry, as is 


fa 
So ci ee no scope for dodging 
V. € suj possible in other modes of examination. 
aluable Pporters of this point of view also assert t 
Ole purpose as a means to evaluate how quickly and 


Can 

give a : h 

ia co-ordinated response to 4 question asked of hi 
hat the student gets an opportu! 


Partj 
displa. Tticular subject. They stress t 
thi e Was effectively he can defend his answer and argue a case. Ț : 
‘ s ADDA Bengal Board of Secondary Education, Calcutta, believes in 
Re j fi ach. It apportions 100 marks for oral exa: different 
“lence ena with the following distribution: languages, 40; p 
» 20; life sciences, 20; history ° India, 10; geograp 


hat the oral test serves & 
how well a student 
m, on the content 
nity to 


Oral examination in languages 


In respect of languages, the West Bengal examiners attempt to evaluate the 
candidate’s power of expression, precision in answering, demeanour, and the 
manner of handling a question. Marks allotted to this area are distributed 
as follows: questions about prose and poetry, 5 marks; questions about 
supplementary reading, 8 marks for prose and 7 marks for the rest; reading 
four lines from prose (supplementary reading), 6 marks; recitation of six 


lines from poetry (supplementary reading), 10 including 2 marks for memo- 
rization; general impression, 4 marks. 


Oral examinations in physical and life sciences 


In physical and life sciences the only criterion of evaluation is a correct and 
precise answer. An attempt is made to preclude the subjectivity of the oral 
examiner in this area by providing him with a set of questions divided into 
two groups. In the first group there are general questions like: ‘What is the 
name of an apparatus under which a person can see plants or animals which 
cannot be seen with the naked eye?’ In the second group are some more 
difficult questions like: ‘State what happens when a red flower moistened 
with water is dropped in a jar of sulphur dioxide.’ ‘Name another gas which 
has this property.’ The complete set of questions is sent in a sealed envelope 
to the Examination Centre by the Board of Secondary Education, and the 
oral examiner opens this question packet just before the examination. The 
only freedom that the examiner has is to select which questions he wants to 
ask of a particular student. 

The total of twenty marks are distributed as follows in each of the two 
subjects areas (physical sciences and life sciences): one general type of ques- 
tion from the first group of given questions, 6 marks; two specific questions 
from the second group of given questions, 10 marks; one question for 
judging the merit and excellence of the students, chosen from the supple- 


mentary questions which appear in brackets appended to questions of the 
second group, 4 marks. 


Oral examinations in history and geography (India and her people) 


As in the previous case, the requirement of a correct and precise answer is 
the only criterion applied. The question papers in this area follow the same 
pattern as in physical and life sciences, except for the merging of subject 
marks so as to provide an option. 

3 The distribution of marks is as follows: one general question from 
history, 3 marks; one general question from geography, 3 marks; one specific 
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question from history, 5 marks; one specific question from geography, 
5 marks; one question of higher difficulty level either from history or geo- 
graphy, 4 marks. 

The scheme is operated by allotting approximately 300 students to each 
examiner. The examiner is expected to devote about 6 to 10 minutes to each 


pupil. 


EVALUATION OF ORAL EXPRESSION THROUGH ORAL EXAMINATIONS 


The advocates of this school of thought are mostly involved with language 
teaching. They believe that speaking is the most important of the four 
linguistic behaviours. Therefore, they hold the view that oral examinations 
should test the ability of a student to speak correctly, fluently and effectively. 
As part of the Examination Reform Programme, an experiment was con- 
ducted by the NCERT, in collaboration with the Central Board of Seconday 
Education, New Delhi, for evolving a system of evaluating speech on the 
basis of this approach. This system was defined by R. G. Misra and K. G 
Rastogi in the following terms: (a) to speak with correct articulation, 
pronunciation, and intonation; (b) to speak in grammatically correct 
language; (c) to make an appropriate use of words, phrases and idioms 
(vocabulary and usage); (d) to express rich and relevant thought content in 
an organized way; (e) to speak fluently (delivery); Q) wherever necessary 
to use appropriate physical gestures for what is being expressed in speech 


(manners and gestures); and (g) to speak effectively. 


Aspects of evaluation and evaluation criteria 


vere further sub-divided for purposes of 


These aspects of oral expression y r -div 
evaluation. These are given in Table 3 with the criteria developed for each 


aspect. 


Conduct of the oral examination 
The experiment provided for three parts in the oral examination. The first 
one was that of ‘conversation’ ; its chief purpose being to establish a rapport 
with the examinee. The other two parts were a ‘short speech’ and “questions A 
The main purpose of these was to test an examinee’s qualities of oral 


expression. a i 
In clear contrast with the West Bengal approach, the test situations setec- 


ted for assessing oral expression Were deliberately selected so that they did 
not involve any specialized knowledge of any subject of study. Themes 
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Taste 3. Evaluation of oral expression 


re 


Area of evaluation 


Aspect of evaluation 


Evaluation criteria 


Pronunciation 


Grammatical 
correctness 


Vocabulary and usage 


Thought content 
and its organization 


Delivery 


Manners and gestures 


Effect 


Articulation 
Accent 
Rhythm 
Pitch 
Intonation 


Structure 
Semantics 


Words 

Phrases 

Idioms 

Proverbs 
Sentence patterns 


Approach 
Ideas 
Arguments 
Conclusion 


Fluency 
Modulation 

Speed 

Verbal mannerism 


Linguistic 

Courtesy 

Attention and respect to 
interviewers (gestures, 
posture and body 
action) 


Intellectual 
Emotional 


Correctness 
Distinctness 
Appropriateness 


Correctness 
Appropriateness 


Extensiveness 
Appropriateness 


Spontaneity 
Richness 
Relevance 
Organization 


Naturalness 
Smoothness 

Adequacy 

Courtesy to interviewers 


Courtesy and 
appropriateness 


Confidence 
Conviction 
Appeal 


were chosen from: (a) the experiences of students in their daily life (like 
accidents, shopping, and so on); (b) the immediate environment (like guests 


54 


in the home, school examinations, etc.); and (c) their co-curriculum activities 
(likes debates, exhibitions, etc.). 

For purposes of evaluation, five-point rating scales (0 to 4) were 
developed and the students were evaluated on them. The categories on the 
rating scales were ‘superior’, ‘goog’, ‘average’, ‘poor’ and ‘very poor’. 
Each student was rated on the seven identified areas of expression. The 
weights given to these aspects of oral expression were as shown in Table 4. 


TABLE 4. Weighting given to oral expression. 


EEE 
Aspects of oral expression Weighting Weighted score factors 
for use with the rating 


scale 
Pronunciation 1 4 
Grammatical correctness of language 2 4 
Vocabulary and usage 2 8 
Thought content and its organization 3 8 
Delivery 1 4 
Manners and gestures 1 4 
Effect 1 4 


For convenience in the use of the five-point rating scale, each of the 


weightings was multiplied by 4. The total of weighted — for each student 
Was divi the score obtained by the student. 
ee ple er was allotted twenty students per day 


In the experiment each examin rd 
and each set of three examiners was given 8 to 10 minutes for ai 
each student. While evaluating 4 candidate on the various areas o tne 
expression, each of the seven areas was constantly kept in view. — 
however, it will be 


i i | practice, 
examiner scored independently. In actua 1 ‘ 
desirable to proceed to the next student after comparing and raat 
the scores for the previous candidate given by the different examine q 


Statistical details of the experiment. 


The experiment included three try-outs, ee = 
Tespectively, with a view to establishing the deg 5 
Procedure, Table 5 shows the results of three try-0 


[57, p. 113-15]. 


10, 20 and 500 students 
e of reliability of the 
ts of the experiment 
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TABLE 5. Rank-order correlations among examiners 


The first try-out (N = 10) 


eA SSSSSFSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS— 


Examiners El E2 E3 
El — .69 .85 
E2 — — 59 
E3 = = 


eee 
Significance level of rhos when N = 10, .05 = 564, .01 = .764. 


The second try-out (N = 20) 
a eee eee 


Examiners El E2 E3 
El — 75 rif’ 
E2 — = 65 
E3 


Significance level of rhos when N = 20, at .05 = .377, .01 = .534, 


The third try-out 
a 


Students Examiners 

XY XZ YZ. N 
A .89 89 90 65 
B 97 .67 .78 70 
C 61 78 -62 121 
D 99 99 99 78 
E 99 .99 .99 50 
F 91 95 96 42 
G 92 91 89 74 

95 94 94 500 


X and Z = external examiner; Y = internal examiner; therefore, YY = 


internal 
and external examiners; N = number of students. 
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CONCLUSION 


While, in our opinion, it is difficult to support the rigidity of the West 
Bengal scheme, our own Delhi experiment cannot be presumed to be the 
ultimately correct approach to all oral testing, for it is specially suited only 
to the area of languages. There could, of course, be no hard and fast rule 
about the use of oral testing and its scope. Both ‘content’, as well as ‘speech’ 
are important in their own right; either or both may be emphasized according 
to the specific purpose of evaluation and the situation in which it is being 


conducted. 
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VI. ‘Prep Index’ 
and evaluation of educational practices 


INTRODUCTION 


The evaluation of educational practices has usually been an arbitrary type 
of assessment, judging mainly in qualitative terms what can be interpreted 
differently by different people. In fact the evaluator on the one hand, and 
the user of an evaluation on the other, often lacked correspondence in their 
points of view. This had very serious consequences for the person evaluated 
as well as creating confusion about the precise definition of the terms used. 

In the spirit of approaching some practical solution to this difficulty the 
concept of ‘Prep Index’ (the index of proficiency in an educational practice) 
was evolved by the Examination Reform Unit. The concept was initially 
applied to teacher education in the area of student teaching. It was later 
extended to the area of games and sports. Since 1976 it has been applied 
on an experimental basis to the area of medical education [54; 58; 125, 
p. 115-34]. 

The Prep Index concept and method has found great acceptance in the 


area of teacher education. It is currently in use in the teacher colleges of 
Kerala, Gujarat and Tamil Nadu, and th 


e idea is fast catching on. In other 
fields it is still at the try-out stage. 

After being introduced to participants of t 
national Seminar on Curriculum Develo: 
Granna, in Sweden in 1971, the Prep Index evoked great interest in several 
developed and developing countries and generated a lot of inquiries and 
requests for its evaluation tools (particularly rating scales). The inquiries 
were answered and materials supplied to the concerned individuals and 
agencies. 


he Unesco-sponsored Inter- 
pment and Evaluation held at 


58 


THEORETICAL FRAMEWORK 


The meaning of evaluation 


‘ s 
Educational evaluation’ is a process of estimating and appraising the degree 
and dimension of students’ achievements. ‘Evaluation of educational 
practice’ is a process of estimating and appraising the proficiency level of 
the particular educational practice which is being conducted. It is a way 
of appraising the application of educational theory in practice. 


Scope for evaluation of educational practices 


Educational practices and the activities related to them can be classified 

under three main headings: 

L. Curriculum activities related to the sul 
with a view to achieving the scholastic objectives. 

2. Co-curriculum activities related to other school programmes and 
practices. These provide a background for the curriculum activities. 
The purpose of organizing them is to promote certain aspects of pupils’ 
growth which, although important ideals of the instructional programme, 
cannot be achieved through the teaching and learning of subjects alone. 


3. Activities related to prognosis, diagnosis, review, motivation, guidance 


and evaluation. 


bjects of instruction, organized 


Pi $ . 
“rpose of evaluating educational practices 
purposes or functions for which 


I 
n a school programme there may be several 
onsidered necesseary. To illus- 


a evaluation of educational practices is ¢ 
1 ate, here are three of them: 
; To discover the extent of competen: 
in initiating, organizing and impro 
2 diagnose his strengths and weaknesses 
+ To predict the educational practices which a part 
Can best participate in or organize. 
At the end of a course, to certify th 
Particular educational practice. 


ce which the student has developed 
ving his day-to-day work, and to 
with a view to further guidance. 
icular student-teacher 


e student’s degree of proficiency in a 


Procedure 

fe Way of an example, let us take co-curricular activities in the schools as 
A i -i 

€ subject of evaluation. The main areas of evaluation for co-curricular 
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activities are: (a) cultural activities; (b) literary activities; (c) games and 
sports; and (d) excursions. Suppose that their respective marking weights 
out of 100 in the programme of a particular school are 25, 25, 40 and 10 
respectively. To focus upon ‘games and sports’ as the area of evaluation for 
one or more student teachers, we may find that it has two main aspects: 
(i) organization of games and sports; and (ii) participation in these activities. 
Then the evaluative criteria for aspect (ii) could be: co-operation with other 
players and with referees or judges; observance of punctuality; respect for 
rules and their observance; sportsmanlike behaviour. 

Given these areas, aspects and criteria of evaluation, the evidence for 
making our judgement about a student’s participation in games and sports 
could be collected by: 


1. Observation of students: before taking part in games or sports events; 
in the course of the events; and after the events. 


2. Anecdotal records of some noteworthy examples of behaviour in 
operational situations. 


The evidence collected may then be summarized. Qualitative summarization 
could be done through descriptive statements; and quantitative summariza-. 


tion through rating scales which in turn are used to derive the Prep Index 
in regard to each aspect of evaluation. 


DERIVATION OF THE ‘PREP INDEX’ 


Let us assume that, for the evaluation of participation in games and sports, 
we have already collected evidence through observation and some anec- 
dotal records. To simplify the example further, let us consider the third 
criterion: ‘respect for rules and their observance’. 
probably will be the most suitable evaluation device. 

If we construct a nine-point scale (with five points defined) for evaluating 
the degree of respect for rules and their observance by a student, it may look 
something like Table 6. 

Usually, the evaluation designer constructs rating scales for each of the 
criteria (in our example, four). If so, the sum of the ratings from each of 
these scales will have to be divided by the number of rating scales prepared. 
The quotient represents the final rating of an individual student on 
cular aspect of evaluation. 

In the example so far, the evaluation, by four criteria, of one of the two 
aspects of ‘games and sports’ has been indicated. However, in our example 
there are three other main areas of evaluation. For convenience, we will 
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Here, a rating scale 


a parti- 


TABLE 6. A nine-point rating scale for evaluating ‘respect for rules and their 
observance’ among students in games and sports 


ee 


8 — Always displays respect for rules and abides by them. 

= 

6 — Seldom displays disrespect for rules or fails to abide by them. 

i 

4 — Normally displays respect for rules and abides by them. 

— 

2 — On most occasions, displays disrespect for rules and seldom abides by them. 
f s 


0— Always displays disrespect for rules and never abides by them. 


assume that, for each main area, the criterion scale ratings have been sum- 
marized (in the way just described) and each main area’s aspect ratings 
merged—although, in principle and practice, they could remain separate 
So as to provide a more detailed analysis. Whatever method is used makes it 
Possible, now, to prepare a visual profile of the evaluated student, such as 


Figure 3, 


FIGURE 3. Visual profile of an evaluated student. 


OHNA 


2 
S 
B 
g 
= 
v 
A 
a 


Cultural 
activities 
Literary 
activities 
Sports and 
games 
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The corresponding ‘Prep Index’ (index of proficiency in co-curricular 
activities) of this student could be calculated as shown in Table 7. 


TABLE 7. The Prep Index for a particular student. 


i 


Co-curriculum Weight- Score on Weighted 
activities ings the scale score 
i Cultural activities 25 2 50 
2: Literary activities 25 2 50 
3. Games and sports 40 6 240 
4. Excursions 10 4 40 
Total 100 14 380 


A ‘perfect’ or maximum weighted score would be 800. 


380 
I = oo % 100 = 47. 
Prep Index 800 10 47.5 


USE OF EVALUATION DATA 


We can now continue, as it were, from the right-hand end of Figure 4, 
Diagnosis 


Educational practices should be incorporated in a school programme with 
a view to achieving some well-defined educational objectives. The achieve- 
ment of these objectives leads to student growth in desirable directions. 
For instance, in the case of student teachers, growth comes about as the 
student organizes the various school programmes and conducts educational 
practices so as, in turn, to ensure developments in pupils as enunciated 
through the learning objectives which apply to them. The extent to which a 
student teacher is currently successful needs to be evaluated. The primary 
purpose of the entire endeavour is to identify the individual’s strengths and 
weaknesses, in preparation for guiding him towards making better personal 
progress and achieving better success with pupils. 


Self evaluation and guidance 


External evaluation of an indi 


vidual’s educational practices—particularly 
throught the development of pr 


ofiles and Prep Indexes at periodic intervals— 
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is an aid to his se/f-evaluation and self-guidance. Being under evaluation 
is a spur to motivation for achieving better success on subsequent occasions. 

The evaluator also finds himself on a better footing to assess a student on 
the basis of the kind of evaluation data that have been described. The 
better he knows a particular student’s development requirements, the more 
precise he can be and the more effective in giving him guidance. 


Certification 


Certification of the student teacher, in regard to the degree of competence 
achieved by him in the respective areas evaluated, is a most important 
function that requires well-founded data. The Prep Index will prove to be 
a more valid indicator of proficiency than intuitive assessment which is 
sometimes capricious or prejudiced. Certification on the basis of a number 


of pertinent and carefully evaluated dimensions will also be more meaningful 
to a person’s employer. 


Prognosis 


Meaningfulness to the employer, in the above sense, 
data could and would be used for predictive purpo: 
what a particular student is likely to accomplish w. 


implies that evaluation 
ses, that is, concerning 
hen he takes up a job. 


CONCLUSION 


As undertaken in the past, evaluation of educational practices tended to be 
arbitrary and unreliable. The development of a consistent methodology of 
evaluating educational practices was therefore necessary; particularly for 
the rating and guidance of student teachers at a crucial Stage in their careers, 
Prep Index is one such methodology which could be applied to all educational 
practices. Evaluation done on the basis of this methodology will, it is hoped, 
yield data which will be more accurate, specific and meaningful for decision 
making than the non-objective impressions, vague memories and emotional 
impulses that underlie snap judgements about an individual. 
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VII. Towards school autonomy 


The dissatisfaction and disillusionment with the traditional system of 


e Panes : ; 
xternal examinations have led educational thinkers to search seriously for 


s A A 
Ome viable alternatives. Even a layman today looks at the present system 


with suspicion. 
In one case where ninety experienced examiners were required to mark 


os be: history answer books, one of the answer books was considered the 
th ee the ten by one experienced examiner, and the worst by another [8]. 
ei e same investigation the only answer book which one examiner consid- 
aas aty of a distinction was failed by seven others; eight gave it a ‘first 
; and the examiners’ marks ranged between 22 per cent and 79 per cent. 

he number of ‘first classes’ awarded by some examiners was larger than the 


number passed by others. 

So whether a candidate fails or gets 4 distinction may often be due as 
eek to ‘luck’ (i.e. which examiner marks his paper) as to ‘merit’. Of course, 
api kind of controlled variability, so unjust to candidates, is one of the 
3 nditions which a reform of the external examination system aims to 

emedy through improvements such as those mentioned in Section III. 
ven so, external examinations are able to address the aptitudes, abilities 
and learnings of students only partially. Some educationists argue that it 
dual on the basis of such 


k not justifiable to pass judgement upon an indivi v 
small sample of the level of his growth. Accordingly, they contemplate 


4 : Eye 
ROE for giving greater autonomy to each school in assessing its own 
Udents 


i 

NTERNAL, ASSESSMENT’: THE FIRST ATTEMPT 

ed this argument when it 
ent must be a party to the 
he seminar was that 20 per 


ons adopt 
dual stud 
from t 


Th ree 
Pa Seminar on Examinatic 
oe ved that the teacher of an indivi 
essment of that student. A suggestion 
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cent of the marks in each subject might be allotted to internal assessment by 
the teachers. f ? 

The idea found favour with several Boards of Secondary Education. 
Those of Bihar, Madhya Pradesh, Punjab and Vidarbha introduced 
internal assessment in their examinations. Under this scheme, if the total 
weighting of a subject was 100 marks and the proportion allotted for internal 
assessment was 20 per cent, the question papers for the external examination 
were set for eighty marks only. The examination subject teachers would 
award marks to their students out of the amount allotted to internal assess- 
ment. These subject-by-subject marks were forwarded to the board by the 
school concerned, so as to be arithmetically added to the score obtained by 
the student in the external examinations. 

This scheme soon started being misused by some unscrupulous schools, 
who saw ‘internal assessment’ as a device for boosting their students’ 
marks. A number of schools did this because of external pressures and out 
of fear. These outcomes led to the scheme being hastily withdrawn by the 
boards concerned. Each of these Boards of Secondary Education had taken 
a fairly long time in reaching its decision to introduce internal assessment: 
but the ‘drop it’ decision resembled the sequence of a chain reaction [74]. 


Setback to the movement 


These successive decision of the boards to withdraw the scheme of internal 
assessment came as a great setback to the movement for giving autonomy 
to schools. The very term ‘internal assessment’ came to be regarded as 
synonymous with educational dishonesty. 

Well-meaning educationists all around the 
thoughts about this movement. The 
success for the internal assessment c 
dampened. 


Even more tragically, a great many honest individuals pursuing the 
noble profession of teaching also lost Prestige because of the actions of a 


few. Their traditional reputation of honesty and integrity was put in 
question. 


country started having second 
y lost hope in the possibility of practical 
Oncept, and their courage to defend it was 


A RENEWED APPROACH 


In spite of this setback, India’s educationists could still not come to terms 
with the increasingly evident defects of examinations. The Examination 
Reform Unit of NCERT was also very disturbed by the situation [101, 103]. 


66 


The topi mi - 
ie E SAh up for discussion when the Sixth Confer 
oneal op a Sa anes of the Boards of Secondary Edueati = 
a a od ovember 1964. As could be expected, by ae 
Alister, A aoe n le differences of opinion among the delegates N ony 

E a ven ideas which have since taken root emerged deus 
particular pan stated, is capable of assessing much more abo 
tions aa aaa oe ee S ever can. External ae 
Scholastic aspects of a Supl ST ec. e r testing 
awe oo a pupil s current understandings; albeit with y 
bie oier Pe à valuation within the school and by the school can. 7 
PUBID per i over both the scholastic and non-scholastic aspe! on 
ence ae es suitable methods and proper ae. slate 
Hake: fa pote eg e this function quite effectively. Despite the initial 

beens P . ; therefore, ought not to be left unexplored. 
inset Acad dedel sed standpoint a comprehensive scheme of internal assess- 
Borat es oped by the Central Examination Unit. The Rajastha 

econdary Education, Ajmer, as usual, volunteered to try it a 


Am 
anual of inst 7 vas á dev d 
ruct 1e was also developed, sul e 
ions for the scheme W Si > ted to th 


Specific s 
needs of Rajasthan. The officials of the state board participated in 


the de 
© develo i Ratt 

pment and finalization of the scheme [10], which after a small- 
4s then introduced in all of the more than 


so 
ate aor for two years wa 

also oe of the state in 1969. At present, Tamil Nadu is 
Proposed ie ae otha in site hundred of 2n secondary schools, and 
schools, e number during 1977 in a phased programme for all 


OUTI 
LINE OF 3 
OF THE COMPREHENSIVE SCHEME 


I. S 
Scholastic aspects 


(a) C 

urricular are i 
lar areas Techniques of as 
Written examination 
Oral examination 
Practical examination 


Tools of assessment 


Question papers 
Diagnostic tests 


Unit tests 
Standardized achievement tests 
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(b) Intelligence 


2. Non-scholastic aspects 


(a) Personal and social qualities 


Regularity 
Punctuality 
Discipline 

Habits of cleanliness 
Emotional stability 
Initiative 
Co-operation 

Sense of responsibility 
Industry 

Civic consciousness 
Spirit of social service 


(b) Interests 


Literary 
Scientific 
Musical 
Artistic 
Social service 


Periodicity of assessment 
Periodical tests 
Terminal tests 

Special tests 

Coverage 

For all students 


Techniques of assessment 

Pencil and paper tests 

Performance tests 

Tools of assessment 

Standardized tests of intelligence and 
abilities 

Periodicity of assessment 

Once a year, preferably at the beginning 
of the school year, 

Coverage 


For all students in the schools where 
facilities are available, 


Techniques of assessment 
Observation 


Tools of assessment 

Anecdotal records 

Rating scales 

Periodicity of assessment 

Once every term, based on observation 
of classroom behaviour; behaviour in 
co-curricular activities; and other inci- 
dental behaviours, 

Coverage 


The first four personal and social qual- 
ities are to be assessed for all students. 
The Temaining personal and social 
qualities, interests, and attitudes are to 
be considered for evaluation only in 
respect of those students in whose cases 
evidence is available. 


(c) Attitudes 


Towards teachers 

Towards studies 

Towards schoolmates 
Towards school programmes 
Towards school property 


(d) Physical health 


Height 

Weight 

Ratio of height to weight 
Chest expansion 

Physical defects, if any 
Eyesight 

Hearing 

Adenoids 

Teeth 

History of diseases, if any 


3. Activities 


GN ge 
(@) Liter ‘ary and scientific 


Library reading 

Debate 

Recitation 

Creative writing 

Speech-making 

Science club 

[The school may organize any 
Other subject club and the necessary 
Tating scales may be prepared 
accordingly.] 


(b) Cultural 


Drama 

Music 

Dance 

gawing and painting 
culpture 

Artistic embroidery 


Techniques of assessment 


Medical check-up 
Observation by the teacher 


Tools of assessment 


Rating scales 
Doctor’s own instruments 


Periodicity of assessment 
Half-yearly 


Coverage 
For all students 


Techniques of assessment 
Observation 

Tools of assessment 
Anecdotal records 
Rating scales 

Periodicity of assessment 
At least once every term. 


Coverage 
Library reading for all students; and 
at least one of the remaining literary, 
scientific and cultural activities for 


each student. 
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(©) Outdoor 


Techniques of assessment 
Games Observation 
Sports 2 Tools of assessment 
Gymnastics dotal d 
Swimming Anec otal = s 
Scouting Rating scales 
National Cadet Corps Periodicity of assessment 
First Aid At least once every term. 
Junior Red Cross 
x j Coverage 
Community service 
Gardening Games and sports for all students; and 
Craft at least one of the remaining activities 


for each student. 


Operation of the scheme 


As a part of the scheme, the tools of assessment (rating scales, checklists, 


inventories, etc.) are prepared and supplied to the teachers along with the 
manual of instructions. 


It may be mentioned that, to ensure the scheme is functional and 
realistic, it is not compulsory for a student to be rated on all interests or 
attitudes, or personal and social qualities. He is rated only in respect of 
those areas in which he shows special promise or specific deficiency as 
Supported by the evidence collected. 


and Proficiency to the students a: 
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improvement. The Progress Report is given to the student every term, but 
a Cumulative Record Card either remains with the school or is transferred 
to another institution where the student may go to study at the request of 
that school. 

There is yet another document called the Personal Data Sheet which 
contains every possible type of individual or family information about a 
student which could have a bearing on his education. The information for 
this document is collected from the parents and is not available to the student 
or any other person. It is used for purposes of diagnosis and remedial/ 
enrichment instruction. 

On the basis of the information and evidence collected, a student is also 
given a final Certificate of Internal Assessment. This certificate is in addition 
udent’s level of performance in external examinations. 
It is given by the school and authenticated under the seal of the Board of 
Secondary Education. A special thing about this certificate is that while it 
gives the average scores of a student in a subject during the past two-to- 
three years, it also gives ratings on personality traits, interests, attitudes and 
So on, only in respect of those areas where the student has some positive 
qualities. Any negative ratings are deliberately not given in the Internal 
Assessment Certificate so that the student may carry this certificate as an 


asset. 
The introduction of this scheme 


to the one given for a st 


has had a very audible influence on the 


tone of the schools and has also helped bring out hidden talents in numerous 
Students. The institutions of higher education—as, also, the employers— 


are beginning to give due recognition to this certificate. 


INTERNAL ASSESSMENT IN SPECIAL SUBJECTS 

essive steps is to leave out of the 
wo special subjects. These subjects 
ment. One of the reasons for this 


One of the comparatively recent progr 
scheme of external examinations one ort 


i S 
are exclusively assigned for internal assess 
is to take a concrete step in the direction of autonomy. The second reason 


is that achievement in these subjects is most difficult, if not rR 

evaluate through external examinations. The main compes Di 

culum areas Ae work experience, health education, and physical e $ 
a y 


Evaluation in work experience 


of introducing this 
al, the 


The j e subject into the curriculum is to 
main purpos c nee ce 
bridge a R REENA the individu school, the society and work. Ina 
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subject of this kind, therefore, it is desirable to assess progress towards the 
following objectives: 


1. Knowledge and understanding of pertinent facts, concepts, materials 
and processes. 


2. Skills related to both the product and process of performance. These 
include: planning and maintenance of sequences in operations; profi- 
ciency in manipulating tools; ingenuity in the use of tools and materials; 
economy in regard to time, labour and cost; adherence to safety rules; 
correct selection of tools; creativity and originality. In regard to a 
specific product, its utility and value, from the point of view of the money 
spent on it, as well as its market Prospects, could count among the criteria. 


3. Among interests and attitudes to be evaluated are consciousness of the 
dignity of labour; self-reliance; social commitment; initiative; regularity 
and punctuality. 


Evidently, the last-mentioned categories, as well as many of the others, 
cannot be evaluated through external evaluations. Instead, there has to be 
oral and practical evaluation, as well as recorded observation. Among 
these types, we may select methods and apportion relative evaluation weigh- 
tings according to our specific situations. The development of adequate tools 
of evaluation like rating scales, checklists, observation schedules and their 
appropriate use by teachers will, of course, be the most important pre- 
Tequisite for effective evaluation. 


Evaluation in physical education 


aluation for any such 
evaluation tools are 
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developed to ensure that evaluation is undertaken continuously, performed 
accurately, and recorded periodically. 


AUTONOMOUS SCHOOLS 


The most important development in this movement is the official designation 
of some excellent schools as autonomous in the real sense of the term. 
Again, Rajasthan was in the vanguard, where in 1976 Vidya Shawan School 
at Udaipur and Banasthali School in Jaipur were declared completely 
autonomous. These two schools have the freedom of developing their own 
Curriculum, choosing their own textbooks, using their own instructional 
Strategies and issuing their own certificates. The board only exercises a 
Superficial kind of control by nominating one member to the academic 
Committees of the schools. This it deems necessary to merit giving its seal 


to the certificate issued by the school. 
to identify fully competent schools 


It is to be hoped that the movement 5 
and then declare them autonomous under due safeguards will spread to 
Other parts of the country as well. The movement gives real direction to a 


purposeful programme of examination reform for our country. 


73 


VIII. Reforms in the mechanics 
of conducting examinations 


This section discusses changes in the ways of conducting examinations which 
have already been introduced. These are improvements which have become 
common to several of the Boards of Secondary Education and state 


Departments of Education conducting external examinations at the school 
stage. 


SOME IMPORTANT INNOVATIONS 


In the traditional pattern, question papers used to be set by a single individual 
and were referred to a moderator afterwards. The latter looked through the 


» but the moderator had a final say in the 
matter. The paper-setter was rarely present at the time the paper was 
moderated; one reason for this was the requirement of secrecy. 


» question papers are set by teams rather than one 
individual, and the institution of 


Several subjects and states. The agencies that have ad 
normally have three people on the paper-setting panel. 
university person (particularly for the secondary school e 
is there to ensure accuracy of the questions in relation to t 
The second is a training college person who keeps a chec 
of the techniques and tools of testing and ensures that ea 


opted this system 
One of these is a 
xaminations) who 
he subject matter. 


g ach question follows 
the rules for framing that specific kind of question. The third person is a 
teacher who keeps watch on the level of the difficulty of the questions and 
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TO ail oE Op E ap with the learning situations in the 
ools. act, ree- er team jointly sets a question paper, 
their interaction does away with the need for a moderator. 

This team of three is normally provided with the design of a question 
paper (see the description given in Section III). To begin with, working 
alone, each individual draws up his own blueprint on the basis of the 
design, and prepares a question paper. Then, all three bring their question 
papers to a central meeting place where they discuss, improve and eventually 
confirm the three separate question papers—there is no attempt to merge 
these into a single paper. At this meeting not only are the individual 
questions verified and confirmed, but also the marking scheme, which gives 
the expected outlines of answers and the marking weights provided for 
each aspect of the answers. The ‘Directions for examinees’ to be printed in 
the question paper, as well as the ‘question-wise analysis’ (which is a check 
on the paper’s calibration to the design and blueprint) are completed at 


the same session. 
Thus, at the conclusion of the meeting, three sets of questions are ready; 
each set complete with its blueprint, marking scheme and question-wise 
d uses one of them for 


analysis. The sets are sealed separately and the boar 
and holds the third 


the final examination, another for the supplementary, 
The main advantage of having three 


in reserve for an emergency situation. 
sets prepared and confirmed simultaneously is that they emerge as parallel 
tests at the design level. Then one of them can be substituted for either of 


the other two without significant loss or gain. 


Scoring of scripts 
n, the examining agencies used to send to the exami- 
s (by subjects and papers), to whom the 
tre was required to despatch the answer 
dure it was easy for examinees 
ho the examiner was, and to 
o the blandishments, threats 


In the traditional patter 
nation centres a list of examiner: 
superintendent of the respective cen 
scripts assigned to each. Under this proce! 
and other interested parties to get to know w. 
approach him. Some examiners did give in t 
and temptations they underwent. 

An attempt to curb such abuses was ma 
requiring all answer scripts to be sent to a cen 
then sorted for despatch to individual examiners. 


scope for malpractices. i 
A further F mprovement, which is now practised by several boards of 
Ilect all the answer books in all subjects and to 


secondary education, is to co l 
give them fictitious ‘code numbers before sending them to the concerned 


de by the examining agencies 
tral location where they were 
Even this procedure left 
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examiners. A fresh formula for giving code numbers is devised every year, 
and the work of putting code numbers on answer books and, after the 
return of examined and marked scripts, of reconverting these numbers to 
the real candidate numbers, is normally entrusted to very senior people of 
high integrity. 

More recently, another method of scoring scripts has been developed, 
and a growing number of examining agencies are using it. This procedure 
is called ‘centralized scoring’. The examining agency collects all the answer 
scripts at a few central locations, to which the examiners are summoned. 
At the particular centre, bundles of thirty to forty answer scripts have been 
made up, and these are handed to the individual examiners, who have to 
examine them under administrative supervision and hand them back before 
they leave. Until their responsibilities have been completed, the examiners 
are not permitted to leave the premises, nor even remove the answer books 
from their desks. This practice has found particular favour with the exami- 
ning agencies because it consumes less time than the other methods do, and 
also because quite often the total of travelling and daily allowance paid to 
the examiners turns out to be much less than the administrative and clerical 
costs, postage and freight incurred in preparation for the exercise itself, 
followed by the sorting, coding, and despatching of scripts and receiving 
them back from the examiners, and so on. Several agencies make on-the-spot 


payments to the examiners for their work, and this is a practical motivation 
for them. 


Use of machines 


The problems of a growing number of examinees, 


7 and of unwieldy adminis- 
trative set-ups, have induced several Boards of 


Secondary Education to 
computers, while others 
at least have their own 
aggering figure of twelve 
ool Examination of the 


operations. Electrical data processing (EDP) equ 
boards by its accuracy; speed in the processing 
economy in respect of money and manpower; and 
more effective management. Machines are being used for processing of 
applications, recording of scores, analysis of results, and issue of certificates; 
besides the conduct of several Studies and investigations which EDP makes 
possible and easy. 


ipment also impresses the 
of results; convenience; 
the scope it provides for 
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Scaling 


Some of the Boards of Secondary Education have started scaling the results 
of individual examinees through various statistical formulae, particularly 
with a view to normalizing the wide variation in the ranges of marks obtained 
by students in different subjects—for example, the range of marks obtained 
in English is much narrower than the range of marks in mathematics [64]. 
But, even now, several of the Boards of Secondary Education, instead of 
scaling the results and despite all criticism, are still giving ‘grace marks’ 
according to arbitrary formulae which they develop more or less every year. 


Change-over to grades 

nation system in India has used a 101-point scale 
students’ levels of achievement in different subjects. 
ns, as also for failure and distinctions, were 
fter which they continued unmodified year 


Traditionally the exami 
(0 to 100) for evaluating 
Precise cut-off points for divisio 
arbitrarily decided in advance; @ 


after year for that particular examination. 
A serious shortcoming of the traditional procedure was that the smallest 


Variabilities of examiners’ judgement, in respect of one mark this way or 
that, changed the division and the fate of the students affected—for these 
judgements were irreversible. Furthermore, high marks could be scored in 
Some subjects while not in others. This made choice of subject an important 
criterion governing the range of marks within which a student could aspire 


to achieve. 

In 1975, NCERT brought out the Framework of curriculum for the 
ten-year school. This document embodied the national consensus on several 
issues, including this one. In summarized form, the recommendations 
regarding declaration of examination results went as follows: 
of achievement of students in different 


l. Ina final certificate, the levels 
f ‘grades’ instead of ‘marks’. 


subjects may be given in terms © 
Grades for different subjects may be indicated separately. 


No over-all grades or d 


The institution of merel; 


should be abolished. l 
nt that students must pass all of a number of subjects at 


m all) should be abolished. 


e opportunity to improve upon their grades 
more subjects again; if desired, separately. 


ivisions should be given. 


y declaring that a student has passed or failed 


5. Any requireme 
the same time (or fail the 
6. Students should be given th 


by subsequently sitting one OF 
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These suggestions have far-reaching implications. When implemented they 
will have the effect of disconnecting examinations at the secondary level from 
a traditional yet distorted function: that of being a ‘go/no-go’ gauge for 
admission to jobs and to courses of higher education. In future, the agencies, 
institutions and organizations concerned will have to develop their own 
admission criteria and devise their own procedure for selection. They may 
even be stimulated to design selection tests suited to their specific needs. 
Thus the omnipotent position which the traditional external examinations 
have been enjoying since 1857, and the multi-purpose role that they have been 
made to play, will at least shrink and might eventually disappear. So this 


sector of reform indeed represents a Positive move in the direction of finally 
abolishing external examinations. 


Curbing malpractices 


Malpractices have a natural knack of creeping into all situations of profit 
and loss. The traditional external examinations, therefore, could not possibly 
be free from these, particularly because of their inflated social and economic 
value [105]. 

Though, on the national scale, there are relatively few instances of mal- 
Practices before and after the external examinations, recently these had 
begun to assume unprecedented dimensions. The problems in a few noto- 
rious examination centres became so serious as to become problems of law 
and order beyond educational solutions. As such, they evoked the following 
rather rigorous measures to curb them: 


1. Promulgation of movement restrictions 


within a range of one mile of an 
examination centre. 


2. Endowing the superintendents of examination centres with first- 
magisterial powers to pass summary sentences on offenders, 


3. Institution of flying squads for surprise checks on examination centres. 


Transfer of teachers from their own schools to others 
invigilating there rather than ‘at home’, 


class 


for purposes of 


5. Transfer of students from their own ti 


© other schools for taking the 
examination. 


6. Prohibition of teachers from i 


nvigilating examinations in their own 
subject fields. 


The Examination Reform Unit nowada 


i ys considers these counter-tractics 
irrelevant, particularly in the context of 


its mission to help provide greater 
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autonomy to the schools in assessing the levels of achievement of their 
students. The anti-malpractice measures unfortunately display a blanket 
mistrust of all teachers, which is neither justified nor desirable. As the 
tension subsides, greater confidence will be reposed in the teacher and his 
ability to assess his student validly, reliably and objectively. It is our hope 
that the time will soon come when only he who teaches shall test. 


INSTITUTION OF CORRESPONDENCE COURSES 


Poor examination pass percentages, particularly among private candidates, 
have led some of the examining agencies to institute correspondence courses. 
These courses have been made compulsory for all candidates who are unable 
or who do not find it convenient to attend regular schools. 

In the Madhya Pradesh Board of Secondary Education, Bhopal, a 
separate division of correspondence courses has been established to look 
after the operation of the whole scheme. 

The board began this endeavour by organizing a correspondence course 
for the Intermediate Examination (class VID). The course content of each 
subject was sub-divided into sixteen units. Experienced teachers prepared 
sequential lessons over each unit, and the resultant courses were vetted by 


a committee. 4 
For all subjects taught, the sixteen lessons are forwarded to the candidates 
n. Every other one (that is, eight in all) has a test at 


the end of it which has to be carried out and scored by the student himself. 
The other eight lessons have exercises and tests which the candidate com- 
pletes and sends in for correction and advice to the tutor to whom he is 


attached. This tutor corrects the scripts and sends them back to the student 
with his comments and suggestions for improvement. The student can also 
get in touch with the tutor for help with any difficulty he may have. 


Under this system, then, students who used to lack the opportunity or 
could not afford the time to g0 to a formal school have been getting educa- 
tional guidance. The first cohort recently appeared at the same examination 
as the regular students who attend schools. The most remarkable outcome 
of this venture was a significant rise in the pass percentage of the private 
candidates, who in years past could have sat the examination without any 


i i i textbook. 
uida teachers Or without having seen a i 
; naa d the attention of advocates of mass education; 


These results have attracte 
and an expansion of such correspondence course programmes can be 


anticipated. 


in fortnightly successio 


719 


To conclude: the attempt in this section has been, not to describe exhaustively 
all measures and innovations that have been introduced, but to highlight 
those improvements in the mechanics of conducting examinations which 


have the closest relationship to the qualitative improvement of the educa- 
tional process and its outcomes. 
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XI. Future outlook 


INTRODUCTION 
Even though the programmes of examination reform in India have made 
considerable progress, so that significant improvements in the practices and 


procedures of conducting examinations are visible, we have still a long way 
new ones invariably 


to go. With the solution of each longstanding problem, 
crop up. Meanwhile, too, with each review that we make, we raise our sights. 
An example of this can be seen in the objectives we have set for our future 
programmes in examination reform. They are stated in the following two 
documents recently published by NCERT: The curriculum for the ten-year 
school [83]; and Higher secondary education and its vocationalisation ( classes 
XI & XII) [84]. 

As the problems of evaluation in the ten-year school and in classes XI 
and XII are slightly different, we will look at them separately. Also, since 
an evaluation scheme can only be understood properly in the context of the 
curriculum design and content, both these aspects will be described as well. 


CURRICULUM AND EVALUATION IN THE TEN-YEAR SCHOOL 


Curriculum 
teaching and learning of different subjects 


to the l 
nal subjects until class X. 


An integrated approach : 
envisages no optio: 


has been adopted which 


1. Areas of school work 
mathematics; environmental studies 


(@) Classes I and II: first language; : 
(social studies and general science); work experience and the arts; 
health education and games. 
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(b) Classes III, IV and V: first language; mathematics; environmental 
studies I (social studies); environmental studies II (general science); 
work experience and the arts; health education and games. 


(c) Classes VI, VII and VIII: the first language continues and a second is 
added (Hindi or English); mathematics (including algebra and geometry); 
social sciences (elements of history, geography, civics, economics); 
science (elements of physical science and life sciences); the arts; work 
experience; physical education, health education and games. 


(d) Classes IX and X: the first and second languages continue and a third is 
added (English or any other Indian language); mathematics (including 
algebra and geometry); social sciences (history, geography, civics, 
economics, psychology); science (the physical sciences and the life 


sciences); the arts; work experience; physical education, health education 
and games. 


A word of explanation should be added here. The scheme presented above 
is illustrative of school work. But one may get an impression that there are 
too many subjects, if one counts each area of curriculum mentioned as a 
subject. Actually, the arts, work experience, physical education, health 
education and games should not be considered as subjects. 


2. Instruction time in school. There should be a minimum of 240 working 
days in the school year, out of which 220 days are for instruction and 20 days 
for school camps, community services and so on. Instructional time in the 
lower primary classes may be from three to four hours per day. In the upper 
primary or middle classes and the lower secondary classes, instructional time 
should not be less than five hours. In addition to the instructional time, each 
school is expected to devote an extra hour per day in the primary classes for 
assembly, routine activities and one or two recesses. In the upper primary 


and lower secondary classes, 50 minutes may be devoted to the morning 
assembly and one recess. 


3. Allocation of time in classes I-V. There should not be a rigid allocation 
of time in these classes, because certain Projects and group activities which 
cut across subject boundaries need flexible scheduling. However, a broad 
indication of the time allotment may be given here. This is indicated below 
in terms of the percentage of total time to be allotted to each area of school 
work. 

(a) Classes I-II: first language, 25 p 
environmental studies (social studi 
work experience and the arts, 
25 per cent. 


er cent; mathematics, 10 per cent; 
es and general sciences), 15 per cent; 
25 per cent; health education and games, 
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(b) Classes III-V: first language, 25 per cent; mathematics, 15 per cent; 
environmental studies I (social studies), 10 per cent; environmental 
studies II (general science), 10 per cent; work experience and the arts, 
20 per cent; health education and games, 20 per cent. 


It should be noted that the first language will also be learned during 
environmental studies and games. Comparably, mathematics also will be 
learned in part through work experience and the arts as well as through 
games. Hence, work experience, arts and games have been given a 40 per cent 
share of time. If they had not, a change away from bookish education and 


rote learning would be difficult to accomplish. 


4. Allocation of time in classes VI-X. Upper primary and lower secondary 
schools should work for six days in the week. Assuming that there would 
be 48 periods per week, each of 30-40 minutes’ duration, the instructional 
periods may be distributed as shown below. However, schools may make 
suitable modifications, wherever necessary, since what is indicated here is 


notional: 


(a) Classes VI-VIII: first language, 8 periods per week; second language, 


5; mathematics, 7; sciences (life sciences and physical sciences), 7; 
social sciences (history, geography, civics and economics), 6; arts, 4; 
work experience, 5; physical education, health education and games, 6. 


(b) Classes IX and X: first language, 6 periods per week; second language, 5; 
third language, 2; mathematics, 7; sciences (life sciences and physical 
sciences), 7; social sciences (history, geography, : 


civics and economics), 7; 
arts, 3: work experience, 5; physical education, health education and 
» 35 
games, 6. 


It may be noted that the proportion of time for languages is slightly less than 
the 25 per cent shown earlier for the primary stage. All the same, it is in- 


tended that the proportion should remain the same in the a ne 
although the number of languages increases to three. ee is wer 

through the life, physical and social sciences as well; and since e me oe 
of instruction is usually the first language, the proportion of ume et fic 
instruction in the first language in the secondary classes a sl a er. 
The effective time for language learning is much more perai itwi ee = 
to be learned through the sciences. The proportion 3 ace y 
experience, the arts and physical education is slightly less than a ri A be 
reduced compared to earlier years. This is because the sciences, the socia 


sciences and mathematics take a larger share of the time—a little less than 
half, in fact. 
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Evaluation and feedback 


The main purpose of evaluation is to see how far the set objectives have been 
achieved through the curriculum. This process is naturally related to the 
learning experiences and methods of teaching that must have been used. 
Evaluation, in order to be useful, should have the following characteristics: 


1. It should give reliable and concrete evidence of the attainment of specific 
objectives. 


2. It should gradually cover a number of objectives and the entire course of 
studies. 


3. It should be done with a variety of tools and tec 
practical and oral tests, observation, ratin 
different objectives and content. 


hniques (written tests, 
g scales, etc.) to measure 


Evaluation should be at several points in time. It should not be a one- 
shot affair at the end of six months or one year, because its purpose is to 
give immediate feedback to pupils and teachers. The pupils should have 
a knowledge of the results of their learning as soon after that learning as 
possible. They should know clearly what they have learned, how much 
they have learned and how well they have learned it. The teacher should 
know from evaluation what his instruction has done, where his instruction 
has failed and where his instruction needs change, so that all the pupils 
are able to master the subject he teaches, or develop the qualities intended 


to be developed by the learning experiences. Hence, evaluation should 
be done by the teacher himself. 


T growth. Such a situation has to be 
e mode of evaluation has to be such 
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At the primary stage, children are young and tender. No rigid system 
of evaluation should be imposed on them at this stage. Evaluation should be 
integrated with the process of learning. A system of continuous recording 
of the progress and development of each child, on the basis of observation 
and oral tests, should be prepared. Promotion should not be based on the 
annual examination at the end of each year, but on the record of progress 
as registered over the session. Normally, all the children should be promoted. 
However, special attention should be given to those who do not show 
adequate progress, and particularly to children from backward sections of 
society. 

Continuous evaluation of the development of the pupils in all aspects 
should be a regular procedure. From the middle stage onwards, the written 
examination should have a place in evaluating the achievement of students 
in subject aeras. But there should be a variety of ways of testing, and not 
just essay tests. Practical tests should be introduced. Observation, checklists, 
oral examination and evaluation of pupil products should also be used as 
tools and techniques of evaluation. Annual examinations may also be held, 
if considered necessary, but these should not be given weight that is unduly 
greater than the other assessments made during the year. The emphasis 
should not be on formal tests for ‘pass or fail in the aggregate’, it should 
be on the assessment of pupil growth, and the guidance of all concerned. 
In fact, there should not be any pass or fail in any examination. Letter 
grading on a five/seven point scale (A, B, C, D, E...) may be conveniently 
used. What is important is to use evaluation for the furtherance of learning. 
This can be done by giving back the corrected answer-books to the students, 
discussing with them the mistakes and showing them how they could do 
better. Afterwards, if any student wishes to improve his grade in any one 
evaluation, he should be given another chance to sit the examination in that 


subject only. 
The school’ 
on record and give 


s cumulative assessment in each subject/unit should be placed 
n to each student. A record of such assessment should 
cover both scholastic and non-scholastic areas, and be without any aggregate. 
Thus, there should be no pass or fail in the final school-leaving certificate. 
This certificate should give only the letter grades (A, B, C, D, E...) of each 
student in the school. Gradually, as the system of internal assessment takes 
root and a system of checking any biases (which lower standards) is evolved, 
the external public examination at the end of class X will become redundant 
and can be abolished. It would be ine each board/state to evolve 
e in order to accomplis 5. 
: eee ae may be established throughout a state. The teachers 
of the school in any one complex can then form a committee which may, 
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from time to time, call for answer-scripts and question papers from the 
schools in their jurisdiction; re-examine samples to check biases; and then 
discuss the matter openly with the teachers concerned. 

District education officers, and inspectors and senior teachers in a 
district, may set up a committee to do such sample checking and discuss 
results with the school complexes concerned. At the state level, there may 
be similar committees. This will be one way of ensuring that evaluation is 
properly performed and standards maintained. Every school should hold 
community meetings from time to time, not only to involve the community 
in the school programme, but also to let the community know how evalua- 
tion is done and used for the improvement of pupil growth and learning as 
well as for the improvement of instruction by the teachers. 


CURRICULUM AND EVALUATION 
FOR THE HIGHER SECONDARY STAGE 


Pattern of courses for academic and vocational streams [83, p. 42-4] 


With regard to the framework of vocational education, as well as that of 
academic education, and the need for providing bridges between the two, the 
following pattern of courses and divisions of time for the academic and the 


vocational streams have been suggested in the report, Higher secondary 
education and its vocationalisation [84, p. 11-13]. 


Stream Time 


(a) Language 
General studies (social economic, 


25 per cent all for streams. 
scientific, etc.); 


(b) Science, social science and humanities, 


75 per cent for the academic 
including literature; 


stream. Students may follow 
courses from (c) also. 
(c) Science, social science and humanities 25 per cent of the vocational 
courses designed to understand the basis stream. 
and scope of various vocations; 


(d) Vocational and practical work; 50 per cent of the vocational 


stream. 


Time is allotted for (a) in such a way that there may be some flexibility in 
apportioning it between language and general studies. It is suggested that 
language may be taught to develop facility in reading, writing and speaking 
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fluently, and in taking part in communicating ideas with clarity and pre- 
cision. It is recommended that none of the two components of category 
(O) should be apportioned less than 10 per cent of the time available. Students 
in the academic stream would be able to study courses from category (b) or 
(c) in accordance with a few rules of combination and with the help of a 
course adviser. This is to ensure that students do not make meaningless 
choices. 

As far as the nature of courses in categories (b) and (c) are concerned. 
there would only be difference in emphasis. For example, when directed 
towards a group of agricultural vocations, category (c) may include soil or 
fertilizer chemistry or the chemistry of pesticides, fungicides, etc. It may 
have courses on biology emphasizing plant pathology and growth stimula- 
tors, or courses in agricultural economics, or land use, or even agricultural 
law concerning ownership. Such courses should naturally be given credit 
as ‘academic’ courses when students of the academic stream are allowed to 
take them, and they should likewise be given full credit on the academic side 
when a student of the vocational stream takes them and is allowed to enter 
the academic stream. Thus, roughly 50 per cent of the courses are ‘common’ 
with transferable credits. Courses in category (d) should be mostly of a 
nature—here, theory should be at a minimum. The laboratory, 


practical 
the main bases for these courses, 


the workshop, or field work should b 


rather than the classroom. 
Courses are to be designed as semester courses in each subject, and 


a ‘modular’ or unit character. That is, in each subject 
y be a few core courses of semester length in category (6); 
ne or two advanced courses in category (b) which students 
level may take. There will also be one or two 


subject falling in category (c) to be taken 
am students. 


they may have 
there may eventuall 
then there may be o 
wishing to go on to the tertiary 
‘applied’ courses in the same 


generally by the vocational stre: ; 
In the matter of language, the schools should provide for at least two 


languages, although a student need only take one. If a student speaks the 
regional language and has also studied in a school where the regional 
language was the medium of instruction, there does not seem to be any 
advantage in forcing the student to learn that language further. If he 
wishes to, he can still study it as an optional category under (b). He may 
benefit from learning another language and, in particular, learning the 
language which may be the medium of instruction where he is studying or 
where he is likely to study- The option of studying an official Indian 
language other than the regional nae should v EaD r pa m 

rovide additional courses for learning English, so 
too; the sehogls shon P has at the high school level may be 


that the deficiencies which a student 


87 


remedied, and that he may become proficient in using this language for 
further learning, particularly at the tertiary stage. Some schools would find 
it possible to provide facilities for learning a foreign language other than 
English. The stress should be on developing language and communication 
skills, and using modern methods of teaching. 

General studies are meant to be a series of courses from which a student 
may receive the equivalent of about 15 per cent of his total education. For 
example, if he has to complete 140 credits in two years, he may gain about 
20 credits in the sphere of general studies. The purpose is to enlarge the 
awareness of the students regarding national culture and heritage, national 
history, and the problem of growth and development of society. The studies 
up to class X already include some of these elements, but the two years which 
a student (from 16+) spends at an institution of higher secondary education 
should be used for a mature discussion of them. It is not foreseen that 
lectures on these subjects are obligatory. In fact, well-conceived discussions 
and seminars, with suggested readings for students (and, of course, provision 
of the books on these subjects in the library) would suffice if these are 
accompanied by suitable internal assessment and terminal examinations. 

In the report of the Education Commission, there is emphasis on work 
experience at this stage of education. It has been included as a subject in the 
scheme presented above. Emphasis on work experience should be compul- 
sory for students in the academic stream, preferably in the form of direct 
involvement in actual productive activity. It should be possible to arrange 
for these students to spend at least a month every year on farms, in factories, 
workshops and offices as student apprentices. Working in an actual em- 
ployment situation provides experience, particularly through interaction 
with other working people, of the problems of social and individual life 
which cannot be obtained from books alone; that is why it is strongly 
recommended. 

In the vocational sector, it is necessary to learn the basic sciences con- 
cerned with a vocation, since the intention is not to produce a man with 
only manual skills. If the vocational course is enriched by science subjects, 
it would become attractive for many intelligent students. Therefore, biology 
(or chemistry or physics or mathematics or economics) concerning the 
vocation has to be taken up through appropriate courses which are to be 
developed. Of course, if a student transfers from the vocational to the 
academic stream, he will carry the credits for this study as well as his credits 
for language and general study. The purpose is that, while 50 per cent of a 
student’s time on the course is spent directly on learning the skills, operations 
and technology of the vocation, he should spend some time on understanding 
the broad social and scientific framework in which that particular vocation 
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operates. It is hoped that he will be able to take responsibility in his vocation 
more intelligently if he has such a knowledge base. 

Work-experience activities are not being proposed as a separate element 
in the vocational sphere because already 50 per cent of a student’s time will 
involve considerable practical/laboratory/field work and apprenticeship in 
relevant enterprises. On-the-job training is a ‘must’ in most of the vocations 
and the school timetables would have to be designed to meet that situation. 


Evaluation at the higher secondary stage [84, p. 17-18] 


One of the major issues engaging the serious attention and thought of 
educators is the system of examination we are using at the higher secondary 
level. A bold attempt should be made to dispense with the public examina- 
tion system and to adopt a system of continuous evaluation. Full-time 
teachers should be encouraged to evaluate their own students. This would 
involve some training for staff working with students in factories, on 
farms, in hospitals, etc., so that confidence can be placed on their judgement 
and evaluation. A system of checking and supervision (perhaps joint exa- 
miners) will have to be developed to ensure that high standards of perfor- 
mance are maintained. Administrative difficulties may arise during the 
implementation, but these have to be solved with imagination, persuasion 
es of examination being suggested would lead to a result card 
showing the various semester courses/training received by the student and 
the grade—on a seven-point scale—obtained in each case. Breaking courses 
down into self-contained units and creating opportunities to improve 
grades later on are part and parcel of this system. It may be emphasized 
that such a result, which is dictated by various practical considerations, 
Tequires either that tertiary institutions should conduct their own a 
tests, or that the state should hold an entrance test for mem a 8 com 
and engineering this is already a wide-spread practice, but k A ga hare 
whenever the number of students desiring admission excee! . x amberat 
places available, the practice of holding an admission sa sg ae ssi 
ered. Even pedagogically, this should be a pear ane see boa 
tude and the academic background required by each faculty ple, 
among science, arts, and commerce—are different. 


i i i t of establishing 
i led with at this stage 1S thal i 
To eh lomas and certificates issued by various 


equivalence among vocational diplon +s 
agencies and of recognizing institutions for the ee = 
employment. This is crucial, especially when several raa pope 
Hill be aiti ding diplomas and certificates. New diplom: 
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holders should have equal opportunities of selection with those coming 
from polytechnics, etc. This is an appropriate sphere of work for the National 
Council of Vocational Education. 

We have emphasized elsewhere that considerable flexibility would be 
built into the system in regard to the duration of education and training. 
Some of the upper secondary courses might be of two semesters’ duration, 
some of three or four semesters, and others even of five or six semesters. 
Therefore, there will not be one rigid system, and students who have been 
educated and trained over different intervals of time will have to be assessed 
differently and appropriate equivalence of courses should be established 
among the ones of nearly equal duration offered in all the vocational 
institutions. For example, a student who undergoes a course of six semesters 
should have no difficulty in comparing his diploma with that of the diploma 
issued by the polytechnic. It is only a question of the competence that the 
student has to reach before a certificate is awarded. It cannot be over- 
emphasized that, by and large, employment opportunities dictate the choice 
of the type of education, especially at the higher secondary stage. The 
present tendency to acquire university degrees, without regard to employ- 
ment conditions, is chiefly due to the prevalent practice of stipulating 
university degrees as minimum qualification for a variety of jobs which 
really do not need the services of graduates. On the other hand, the diploma 
or certificate holders with adequate skill and Competence can very well fit 
into a large range of jobs. This aspect will have to be given due and urgent 
consideration, and steps will have to be devised to impress this upon all 
appointing agencies. If this principle is explicitly accepted, it will be possible 
to attract a large section of youth to vocational courses. This incentive can 
be further advanced if a policy decision at the highest level is taken to offer 
salaries to the diploma or certificate holders that are equal or comparable 
to those of university graduates, when skills in which the former have 
been trained are the basis of selection. A step in this direction has already 
been taken by adopting a resolution to this effect, in a meeting of the State 


Education Secretaries held on 6 and 7 June 1975. It is hoped that the 
resolution will soon be implemented, 
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